"Eigenlips" for Robust Speech Recognition
| Title | "Eigenlips" for Robust Speech Recognition |
| Publication Type | Technical Report |
| Year of Publication | 1994 |
| Authors | Bregler, C., & Konig Y. |
| Other Numbers | 872 |
| Abstract | In this study we improve the performance of a hybrid connectionist speech recognition system by incorporating visual information about the corresponding lip movements. Specifically, we investigate the benefits of adding visual features in the presence of additive noise and crosstalk (cocktail party effect). Our study extends previous experiments by using a new visual front end, and an alternative architecture for combining the visual and acoustic information. Furthermore, we have extended our recognizer to a multi-speaker, connected letters recognizer. Our results show a significant improvement for the combined architecture (acoustic and visual information) over just the acoustic system in the presence of additive noise and crosstalk. |
| URL | http://www.icsi.berkeley.edu/ftp/global/pub/techreports/1994/tr-94-002.pdf |
| Bibliographic Notes | ICSI Technical Report TR-94-002 |
| Abbreviated Authors | C. Bregler and Y. Konig |
| ICSI Publication Type | Technical Report |