Multi-Modal Speaker Diarization of Real-World Meetings Using Compressed-Domain Video Features
Title | Multi-Modal Speaker Diarization of Real-World Meetings Using Compressed-Domain Video Features |
Publication Type | Technical Report |
Year of Publication | 2008 |
Authors | Friedland, G., Hung H., & Yeo C. |
Other Numbers | 2371 |
Abstract | Speaker diarization is originally defined as the task of determining who spoke when given an audio track and no other prior knowledge of any kind. The following article shows a multi-modal approach where we improve a state-of-the-art speaker diarization system by combining standard acoustic features (MFCCs) with compressed domain video features. The approach is evaluated on over 4.5 hours of the publicly available AMI meetings dataset which contains challenges such as people standing up and walking out of the room. We show a consistent improvement of about 34% relative in speaker error rate (21% DER) compared to a state-of-the-art audio-only baseline. |
URL | http://www.icsi.berkeley.edu/pubs/techreports/tr-08-007.pdf |
Bibliographic Notes | ICSI Technical Report TR-08-007 |
Abbreviated Authors | G. Friedland, H. Hung, and C. Yeo |
ICSI Research Group | Speech |
ICSI Publication Type | Technical Report |