Unsupervised Speaker Identification in TV Broadcast Based on Written Names

Johann Poignant 1 Laurent Besacier 2 Georges Quénot 3
3 MRIM - Modélisation et Recherche d’Information Multimédia [Grenoble]
LIG - Laboratoire d'Informatique de Grenoble, Inria - Institut National de Recherche en Informatique et en Automatique
Abstract : Identifying speakers in TV broadcast in an unsuper- vised way (i.e. without biometric models) is a solution for avoiding costly annotations. Existing methods usually use pronounced names, as a source of names, for identifying speech clusters provided by a diarization step but this source is too imprecise for having sufficient confidence. To overcome this issue, another source of names can be used: the names written in a title block in the image track. We first compared these two sources of names on their abilities to provide the name of the speakers in TV broadcast. This study shows that it is more interesting to use written names for their high precision for identifying the current speaker. We also propose two approaches for finding speaker identity based only on names written in the image track. With the "late naming" approach, we propose different propagations of written names onto clusters. Our second proposition, "Early naming", modifies the speaker diarization module (agglomerative clustering) by adding constraints preventing two clusters with different associated written names to be merged together. These methods were tested on the REPERE corpus phase 1, containing 3 hours of annotated videos. Our best "late naming" system reaches an F-measure of 73.1%. "early naming" improves over this result both in terms of identification error rate and of stability of the clustering stopping criterion. By comparison, a mono-modal, supervised speaker identification system with 535 speaker models trained on matching development data and additional TV and radio data only provided a 57.2% F-measure.
Type de document :
Article dans une revue
IEEE Transactions on Audio, Speech and Language Processing, Institute of Electrical and Electronics Engineers, 2015, 23 (1), pp.57-68. 〈https://dl.acm.org/authorize?N46627〉. 〈10.1109/TASLP.2014.2367822〉
Liste complète des métadonnées

Littérature citée [35 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01060827
Contributeur : Laurent Besacier <>
Soumis le : jeudi 4 septembre 2014 - 12:07:23
Dernière modification le : jeudi 11 octobre 2018 - 08:48:04
Document(s) archivé(s) le : vendredi 5 décembre 2014 - 10:25:54

Fichier

POIGNANT--ASLP--2013-2.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Johann Poignant, Laurent Besacier, Georges Quénot. Unsupervised Speaker Identification in TV Broadcast Based on Written Names. IEEE Transactions on Audio, Speech and Language Processing, Institute of Electrical and Electronics Engineers, 2015, 23 (1), pp.57-68. 〈https://dl.acm.org/authorize?N46627〉. 〈10.1109/TASLP.2014.2367822〉. 〈hal-01060827〉

Partager

Métriques

Consultations de la notice

391

Téléchargements de fichiers

567