Fuzzy integrals for the aggregation of confidence measures in speech recognition

Julie Mauclair (1, 2) , Laurent Wendling (2) , David Janiszek (2)

1 IRIT-SAMoVA - Équipe Structuration, Analyse et MOdélisation de documents Vidéo et Audio
2 LIPADE (URP_2517) - Laboratoire d'Informatique Paris Descartes

This paper presents a study on merging confidence measures using fuzzy logic. Instead of the previous approaches using the notion of probability, we propose to observe the uncertainty of the recognition hypotheses and the notion of possibility thanks to fuzzy reasoning. Four different confidence measures are developed, coming from different parts of a speech recognizer. Various merging methods are studied to improve the performance of the confidence measures. The methods are evaluated in terms of Confidence Error Rate (CER) and in terms of their Detection Error Tradeoff (DET) curves on a French broadcast news corpus. They are compared to some fuzzy logic aggregation techniques among which the technique based on the Choquet Integral yields to a significant improvement in terms of CER.

Mots clés: fuzzy logic; confidence measures; speech recognition; feature aggregation; acoustic measurements

Domaines: Traitement du signal et de l'image [eess.SP]; Logique en informatique [cs.LO]

Julie Mauclair, Laurent Wendling, David Janiszek. Fuzzy integrals for the aggregation of confidence measures in speech recognition. IEEE International Conference on Fuzzy Systems (FUZZ 2011), Institute of Electrical and Electronics Engineers (IEEE); IEEE Computational Intelligence Society (CIS); National Chiao Tung University, Taiwan, R. O. C.; National University of Tainan, Taiwan, R. O. C.; National Cheng Kung University, Taiwan, R. O. C.; Osaka Prefecture University, Japan, Jun 2011, Taipei, Taiwan. pp.1149-1156, ⟨10.1109/FUZZY.2011.6007654⟩. ⟨hal-03543186⟩