Unsupervised Speaker Identification using Overlaid Texts in TV Broadcast

Abstract : We propose an approach for unsupervised speaker identification in TV broadcast videos, by combining acoustic speaker diarization with person names obtained via video OCR from overlaid texts. Three methods for the propagation of the overlaid names to the speech turns are compared, taking into account the co-occurence duration between the speaker clusters and the names provided by the video OCR and using a task-adapted variant of the TF-IDF information retrieval coefficient. These methods were tested on the REPERE dry-run evaluation corpus, containing 3 hours of annotated videos. Our best unsupervised system reaches a F-measure of 70.2% when considering all the speakers, and 81.7% if anchor speakers are left out. By comparison, a mono-modal, supervised speaker identification system with 535 speaker models trained on matching development data and additional TV and radio data only provided a 57.5% F-measure when considering all the speakers and 45.7% without anchor.
Type de document :
Communication dans un congrès
Interspeech 2012 - Conference of the International Speech Communication Association, Sep 2012, Portland, OR, United States. 4p., 2012
Liste complète des métadonnées

Littérature citée [8 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-00767427
Contributeur : Georges Quénot <>
Soumis le : mercredi 19 décembre 2012 - 18:08:36
Dernière modification le : samedi 15 décembre 2018 - 01:49:31
Document(s) archivé(s) le : mercredi 20 mars 2013 - 11:37:19

Fichier

Poignant-al_Interspeech2012.pd...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00767427, version 1

Citation

Johann Poignant, Hervé Bredin, Viet-Bac Le, Laurent Besacier, Claude Barras, et al.. Unsupervised Speaker Identification using Overlaid Texts in TV Broadcast. Interspeech 2012 - Conference of the International Speech Communication Association, Sep 2012, Portland, OR, United States. 4p., 2012. 〈hal-00767427〉

Partager

Métriques

Consultations de la notice

462

Téléchargements de fichiers

193