A Multi-Modal Recognition System Using Face and Speech

Samir Akrouf (1) , Yahia Belayadi (1) , Messaoud Mostefai (1) , Youssef Chahir (2)

1 LMSE laboratory
2 Equipe Image - Laboratoire GREYC - UMR6072

Nowadays Person Recognition has got more and more interest especially for security reasons. The recognition performed by a biometric system using a single modality tends to be less performing due to sensor data, restricted degrees of freedom and unacceptable error rates. To alleviate some of these problems we use multimodal biometric systems which provide better recognition results. By combining different modalities, such us speech, face, fingerprint, etc., we increase the performance of recognition systems. In this paper, we study the fusion of speech and face in a recognition system for taking a final decision (i.e., accept or reject identity claim). We evaluate the performance of each system differently then we fuse the results and compare the performances.

Mots clés: decision fusion; Biometrics; data fusion; face recognition; automatic speaker recognition; data processing; decision fusion.

Domaines: Traitement des images [eess.IV]

Samir Akrouf, Yahia Belayadi, Messaoud Mostefai, Youssef Chahir. A Multi-Modal Recognition System Using Face and Speech. International Journal of Computer Science Issues, 2011, 8 (3), pp.1694-0814. ⟨hal-00809124⟩