Multi-Modal Speaker Diarization of Real-World Meetings Using Compressed-Domain Video Features

TitleMulti-Modal Speaker Diarization of Real-World Meetings Using Compressed-Domain Video Features
Publication TypeTechnical Report
Year of Publication2008
AuthorsFriedland, G., Hung H., & Yeo C.
Other Numbers2371
Abstract

Speaker diarization is originally defined as the task of determining “who spoke when” given an audio track and no other prior knowledge of any kind. The following article shows a multi-modal approach where we improve a state-of-the-art speaker diarization system by combining standard acoustic features (MFCCs) with compressed domain video features. The approach is evaluated on over 4.5 hours of the publicly available AMI meetings dataset which contains challenges such as people standing up and walking out of the room. We show a consistent improvement of about 34% relative in speaker error rate (21% DER) compared to a state-of-the-art audio-only baseline.

URLhttp://www.icsi.berkeley.edu/pubs/techreports/tr-08-007.pdf
Bibliographic Notes

ICSI Technical Report TR-08-007

Abbreviated Authors

G. Friedland, H. Hung, and C. Yeo

ICSI Research Group

Speech

ICSI Publication Type

Technical Report