Computer-assisted Speaker Diarization: How to Evaluate Human Corrections

Pierre-Alexandre Broux (1, 2) , David Doukhan (1) , Simon Petitrenaud (2) , Sylvain Meignier (2) , Jean Carrive (1)

1 INA - Institut National de l'Audiovisuel
2 LIUM - Laboratoire d'Informatique de l'Université du Mans

In this paper, we present a framework to evaluate the human corrections of a speaker diarization. We propose four elementary actions to correct the diarization and an automaton to simulate the correction sequence. A metric is described to evaluate the correction cost. The framework is evaluated using French broadcast news drawn from the REPERE corpus.

Mots clés: Speaker diarization; annotation; Human-Computer Interaction (HCI); evaluation

Domaines: Traitement du signal et de l'image [eess.SP]; Intelligence artificielle [cs.AI]; Interface homme-machine [cs.HC]

Pierre-Alexandre Broux, David Doukhan, Simon Petitrenaud, Sylvain Meignier, Jean Carrive. Computer-assisted Speaker Diarization: How to Evaluate Human Corrections. LREC 2018, Eleventh International Conference on Language Resources and Evaluation, May 2018, Miyazaki, Japan. ⟨hal-01987198⟩