Decoding visemes: improving machine lipreading

10/03/2017
by   Helen L Bear, et al.
0

To undertake machine lip-reading, we try to recognise speech from a visual signal. Current work often uses viseme classification supported by language models with varying degrees of success. A few recent works suggest phoneme classification, in the right circumstances, can outperform viseme classification. In this work we present a novel two-pass method of training phoneme classifiers which uses previously trained visemes in the first pass. With our new training algorithm, we show classification performance which significantly improves on previous lip-reading results.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset