Lipreading mobile phone

18 03 2010

A prototype lip reading mobile phone promises to end noisy phone calls. The technology allows people to have silent phone conversations by measuring the tiny electrical signals produced by muscles used when someone speaks.

The phone can record these pulses even when a person does not audibly utter any words and use them to generate synthesised speech in another handset.

The device was on show at the Cebit electronics fair (2-6 March) in Germany. It relies on a technique called electromyography which detects the electrical signals from muscles. It is commonly used to diagnose certain diseases, including those that involve nerve damage.

The prototype that was on display in Germany uses nine electrodes that are stuck to a user’s face. These capture the electrical potentials that result from moving the articulatory muscles used to produce speech. The electrical pulses are then passed to a device which records and amplifies them before transmitting the signal via Bluetooth to a laptop. There, software translates the signals into text, which can then be spoken by a synthesiser. In the future, the technology could be packed in a mobile phone for instantaneous communication. It could also form the basis of an instant translation system.

It is not the first time that electromyography has been explored for silent communication. The US space agency Nasa has investigated the technique for communicating in noisy environments such as the Space Station. It has also used the technique to explore advanced flight control systems that do away with joysticks and other interfaces. Nasa explored the technique to understand simple commands. The difference with this prototype  is that continually spoken sentences can be recorded and recognised.

Source BBC News

Exciting, eh? More electrodes for me! Although how Text Relay would cope with this, poses an interesting question …