Sign In

Communications of the ACM

ACM TechNews

Lip-Reading Software Helps Users of All Abilities to Send Secure Messages

View as: Print Mobile App Share:
Reading lips.

A computer science lab focused on making human-computer interaction easier for people of all abilities has developed a digital lip-reader complete with its own repair system so the software can learn from its user.

Credit: Shutterstock

Lip-reading software developed by researchers at the University of California, Merced (UC Merced)'s Human-Computer Interaction Group can continuously learn from its users.

LipType allows users to send texts or emails on their computers and mobile devices, and contactlessly engage with public devices without speaking aloud.

The UC Merced team incorporated filters for different lighting conditions and a mistake-corrector based on different language models into LipType, which proved faster and less error-prone than other lip-reader software.

UC Merced's Laxmi Pandey said, "LipType performed 58% faster and 53% more accurately than other state-of-the-art models in various real-world settings, including poor lighting and busy market situations."

From University of California News
View Full Article


Abstracts Copyright © 2021 SmithBucklin, Washington, DC, USA


No entries found

Sign In for Full Access
» Forgot Password? » Create an ACM Web Account