Combining Speaker Turn Embedding and Incremental Structure Prediction for Low-Latency Speaker Diarization

Abstract : Real-time speaker diarization has many potential applications, including public security, biometrics or forensics. It can also significantly speed up the indexing of increasingly large multimedia archives. In this paper, we address the issue of low-latency speaker diarization that consists in continuously detecting new or reoccurring speakers within an audio stream, and determining when each speaker is active with a low latency (e.g. every second). This is in contrast with most existing approaches in speaker diarization that rely on multiple passes over the complete audio recording. The proposed approach combines speaker turn neural embeddings with an incremental structure prediction approach inspired by state-of-the-art Natural Language Processing models for Part-of-Speech tagging and dependency parsing. It can therefore leverage both information describing the utterance and the inherent temporal structure of interactions between speakers to learn, in supervised framework, to identify speakers. Experiments on the Etape broadcast news benchmark validate the approach.
Document type :
Conference papers
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01987809
Contributor : Hervé Bredin <>
Submitted on : Monday, January 21, 2019 - 12:36:39 PM
Last modification on : Friday, July 19, 2019 - 2:44:04 PM

Identifiers

  • HAL Id : hal-01987809, version 1

Citation

Guillaume Wisniewski, Hervé Bredin, Grégory Gelly, Claude Barras. Combining Speaker Turn Embedding and Incremental Structure Prediction for Low-Latency Speaker Diarization. Interspeech 2017, 18th Annual Conference of the International Speech Communication Association, 2017, Stockholm, Sweden. ⟨hal-01987809⟩

Share

Metrics

Record views

21