Presentation matters: Evaluating speaker identification tasks - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Presentation matters: Evaluating speaker identification tasks

Benjamin O'Brien
Christine Meunier
Alain Ghio

Résumé

This paper details our evaluations and comparisons of speaker identification (SID) performance by listeners across different tasks. Experiment 1 participants completed traditional targetlineup (1-out-of-N speakers or out-of-set speaker) and binary (speaker verification) tasks. Experiment 2 participants completed trials online by using a clustering method by grouping speech recordings into speaker-specific clusters. Both studies employed similar speech recordings from the PTSVOX corpus. Our results showed participants who completed the binary and clustering tasks had higher accuracy than those who completed the target-lineup task. We also observed that independent of the tasks participants found some speakers significantly more difficult to identify relative to their foils. Pearson correlation procedures showed significant negative correlations between accuracy and task-dependent temporal-based metrics across tasks, where an increase in time required to make determinations yielded a decrease in perceptual SID performance. These findings underscored the important role of SID task design and the process of selecting speech recordings. Future work aims to examine the relationship between different perceptual SID task performances and scores generated by automatic speaker verification systems.
Fichier principal
Vignette du fichier
VoxCrim_INTERSPEECH_2021.pdf (260.8 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03267089 , version 1 (22-06-2021)

Identifiants

  • HAL Id : hal-03267089 , version 1

Citer

Benjamin O'Brien, Christine Meunier, Alain Ghio. Presentation matters: Evaluating speaker identification tasks. INTERSPEECH 2021, Aug 2021, Brno, Czech Republic. ⟨hal-03267089⟩
77 Consultations
100 Téléchargements

Partager

Gmail Facebook X LinkedIn More