Multi-lingual lip reading computers

31 07 2009

New lip-reading computers can ‘speak’ everything from English and Arabic to Cantonese and Italian.

The technology, developed by scientists at the University of East Anglia, was developed by modelling the lip movements of 23 bilingual and trilingual speakers. They reckon it could bring huge benefits to deaf people, to law enforcement agencies and those operating in noisy environments.

Professor Stephen Cox, who led the research, said it had confirmed long held beliefs about lip movement and language. He said: “This is an exciting advance in automatic lip reading technology and the first scientific confirmation of something we already intuitively suspected – that when people speak different languages they use different mouth shapes in different sequences. For example, we found frequent ‘lip-rounding’ among French speakers and more prominent tongue movements among Arabic speakers.” The ground-breaking research was presented at a major conference in Taiwan in April.

(Hell, I could’ve told them that!)

Source: Engineering and Physical Sciences Research Council
This was also reported by BBC News.

Advertisements

Actions

Information

One response

6 08 2009
Wellescent Health Forums

Very interesting find. I wonder how effective the technique is in comparison to voice recognition. It would be interesting to see if it could be combined with voice recognition to get an overall improvement in recognition accuracy.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s