A conditional random field approach for face identification in broadcast news using overlaid text

Abstract : We investigate the problem of face identification in broadcast programs where people names are obtained from text overlays automatically processed with Optical Character Recognition (OCR) and further linked to the faces throughout the video. To solve the face-name association and propagation, we propose a novel approach that combines the positive effects of two Conditional Random Field (CRF) models: a CRF for person diarization (joint temporal segmentation and association of voices and faces) that benefit from the combination of multiple cues including as main contributions the use of identification sources (OCR appearances) and recurrent local face visual background (LFB) playing the role of a namedness feature; a second CRF for the joint identification of the person clusters that improves identification performance thanks to the use of further diarization statistics. Experiments conducted on a recent and substantial public dataset of 7 different shows demonstrate the interest and complementarity of the different modeling steps and information sources, leading to state of the art results.
Type de document :
Communication dans un congrès
IEEE International Conference on Image Processing 2014, 2014, Paris, France. pp.318 - 322, 2014, Image Processing (ICIP), 2014 IEEE International Conference on. 〈10.1109/ICIP.2014.7025063〉
Liste complète des métadonnées

Littérature citée [23 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01433221
Contributeur : Sylvain Meignier <>
Soumis le : samedi 1 avril 2017 - 00:36:34
Dernière modification le : jeudi 6 avril 2017 - 10:08:03
Document(s) archivé(s) le : dimanche 2 juillet 2017 - 12:17:29

Fichier

Gay_ICIP_2014.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Paul Gay, Elie Khoury, Sylvain Meignier, Jean-Marc Odobez, Paul Deléglise. A conditional random field approach for face identification in broadcast news using overlaid text. IEEE International Conference on Image Processing 2014, 2014, Paris, France. pp.318 - 322, 2014, Image Processing (ICIP), 2014 IEEE International Conference on. 〈10.1109/ICIP.2014.7025063〉. 〈hal-01433221〉

Partager

Métriques

Consultations de la notice

127

Téléchargements de fichiers

118