acm-header
Sign In

Communications of the ACM

ACM TechNews

Mobile Phones Learn to Lip Read


View as: Print Mobile App Share:
mobile phone

Professor Tanja Shultz's prototype allows mobile phone users to converse in silence.

Credit: abola.pt

Karlsruhe Institute of Technology professor Tanja Shultz demonstrated a prototype device for communicating without speaking at the recent CeBIT conference. The technology uses electromyography to detect the electrical signals muscles produce when someone speaks, which also is a technique commonly used to diagnose certain diseases.

For the prototype, nine electrodes are attached to a user's face. "These capture the electrical potentials that result from you moving your articulatory muscles," Shultz says. The technology passes the electrical pulses to a device that records and amplifies them, and transmits the signal via Bluetooth to a laptop, where software translates the signals into text that can be spoken by a synthesizer.

Shultz says the technology could be used by people who have lost their voice, or could support an instant translation system. Also, by integrating the lip-reading technology into mobile phones, commuters would be able to engage in silent phone conversations, Shultz says.

From BBC News
View Full Article

 

Abstracts Copyright © 2010 Information Inc., Bethesda, Maryland, USA


 

No entries found

Sign In for Full Access
» Forgot Password? » Create an ACM Web Account