HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Towards large scale multimedia indexing: A case study on person discovery in broadcast news

Nam Le 1 Hervé Bredin 2 Gabriel Sargent 3 Miquel India 4 Paula Lopez-Otero 5 Claude Barras 2 Camille Guinaudeau 2 Guillaume Gravier 3 Gabriel Barbosa da Fonseca 6 Izabela Lyon Freire 6 Zenilton Patrocínio Jr 6 Silvio Jamil F. Guimarães 6 Gerard Martí 4 Josep Ramon Morros 4 Javier Hernando 4 Laura Docio-Fernandez 5 Carmen Garcia-Mateo 5 Sylvain Meignier 7 Jean-Marc Odobez 1
1 IDIAP Research Institute
2 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur
3 LinkMedia - Creating and exploiting explicit links between multimedia fragments
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
4 UPC - Universitat Politècnica de Catalunya [Barcelona]
5 TSC - Departamento de Teoría de la Señal y Comunicaciones (Universidad de Vigo )
6 PUC Minas
7 LIUM - Laboratoire d'Informatique de l'Université du Mans
Abstract : The rapid growth of multimedia databases and the human interest in their peers make indices representing the location and identity of people in audiovisual documents essential for searching archives. Person discovery in the absence of prior identity knowledge requires accurate association of audiovisual cues and detected names. To this end, we present 3 different strategies to approach this problem: clustering-based naming, verification-based naming, and graph-based naming. Each of these strategies utilizes different recent advances in unsupervised face / speech representation, verification, and optimization. To have a better understanding of the approaches, this paper also provides a quantitative and qualitative comparative study of these approaches using the associated corpus of the Person Discovery challenge at MediaEval 2016. From the results of our experiments, we can observe the pros and cons of each approach, thus paving the way for future promising research directions.
Keywords : person discovery Multimedia Multimodal analysis
Document type :
Conference papers
Complete list of metadata

Cited literature [33 references]  Display  Hide  Download
https://hal.archives-ouvertes.fr/hal-01551690
Contributor : Gabriel Sargent Connect in order to contact the contributor
Submitted on : Friday, June 30, 2017 - 2:28:16 PM
Last modification on : Friday, April 8, 2022 - 4:08:03 PM
Long-term archiving on: : Monday, January 22, 2018 - 8:15:49 PM

File

Vignette du document
Le_et_al_CBMI.pdf
Files produced by the author(s)

Identifiers

Collections

CNRS | UNIV-RENNES1 | UNIV-LEMANS | LIUM | IRISA | INRIA | UR1-MATH-STIC | UNIV-PARIS-SACLAY | UR1-UFR-ISTIC | LIMSI | UNIV-RENNES | SORBONNE-UNIVERSITE | LIUM-LST | INSA-RENNES | SU-TI | UR1-MATH-NUM | LISN | GS-COMPUTER-SCIENCE | GS-ENGINEERING | INRIA2

Citation

Nam Le, Hervé Bredin, Gabriel Sargent, Miquel India, Paula Lopez-Otero, et al.. Towards large scale multimedia indexing: A case study on person discovery in broadcast news. Content-Based Multimedia Indexing CBMI, Jun 2017, Firenze, Italy. ⟨10.1145/3095713.3095732⟩. ⟨hal-01551690⟩

Export

BibTeX TEI DC DCterms EndNote Datacite

Share

Metrics

Record views

1795

Files downloads

141