OCR-aided person annotation and label propagation for speaker modeling in TV shows

Abstract : In this paper, we present an approach for minimizing human effort in manual speaker annotation. Label propagation is used at each iteration of an active learning cycle. More precisely, a selection strategy for choosing the most suitable speech track to be labeled is proposed. Four different selection strategies are evaluated and all the tracks in a corresponding cluster are gathered using agglomerative clustering in order to propagate human annotations. To further reduce the manual labor required, an optical character recognition system is used to bootstrap annotations. At each step of the cycle , annotations are used to build speaker models. The quality of the generated speaker models is evaluated at each step using an i-vector based speaker identification system. The presented approach shows promising results on the REPERE corpus with a minimum amount of human effort for annotation .
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [17 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01350071
Contributor : Laurent Besacier <>
Submitted on : Friday, July 29, 2016 - 3:34:47 PM
Last modification on : Thursday, April 4, 2019 - 10:18:05 AM

File

ocr-aided-person-4.pdf
Files produced by the author(s)

Identifiers

Citation

Mateusz Budnik, Laurent Besacier, Ali Khodabakhsh, Cenk Demiroglu. OCR-aided person annotation and label propagation for speaker modeling in TV shows. IEEE ICASSP 2016, Mar 2016, Shangai, China. 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2016, 〈10.1109/ICASSP.2016.7472743〉. 〈hal-01350071〉

Share

Metrics

Record views

176

Files downloads

65