Détection de locuteurs dans les séries TV

Abstract : Speaker diarization of audio streams turns out to be particularly challenging when applied to fictional films, where many characters talk in various acoustic conditions (background music, sound effects, variations in intonation...). Despite this acoustic variability, such movies exhibit specific visual patterns, particularly within dialogue scenes. In this paper, we introduce a two-step method to achieve speaker diarization in TV series: speaker diarization is first performed locally within scenes visually identified as dialogues; then, the hypothesized local speakers are compared to each other during a second clustering process in order to detect recurring speakers: this second stage of clustering is subject to the constraint that the different speakers involved in the same dialogue have to be assigned to different clusters. The performances of our approach are compared to those obtained by standard speaker diarization tools applied to the same data.
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01313094
Contributor : Bibliothèque Universitaire Déposants Hal-Avignon <>
Submitted on : Monday, December 17, 2018 - 1:41:58 PM
Last modification on : Friday, March 22, 2019 - 11:34:07 AM
Long-term archiving on : Monday, March 18, 2019 - 4:05:46 PM

Files

seg_loc.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01313094, version 1
  • ARXIV : 1812.07200

Collections

Citation

Xavier Bost, Georges Linares. Détection de locuteurs dans les séries TV. Coria 2015, Mar 2015, Paris, France. ⟨hal-01313094⟩

Share

Metrics

Record views

57

Files downloads

29