Content-based search in multilingual audiovisual documents using the International Phonetic Alphabet

Abstract : We present in this paper an approach based on the use of the International Phonetic Alphabet (IPA) for content-based indexing and retrieval of multilingual audiovisual documents. The approach works even if the languages of the document are unknown. It has been validated in the context of the ''Star Challenge'' search engine competition organized by the Agency for Science, Technology and Research (A*STAR) of Singapore. Our approach includes the building of an IPA-based multilingual acoustic model and a dynamic programming based method for searching document segments by ''IPA string spotting''. Dynamic programming allows for retrieving the query string in the document string even with a significant transcription error rate at the phone level. The methods that we developed ranked us as first and third on the monolingual (English) search task, as fifth on the multilingual search task and as first on the multimodal (audio and image) search task.
Type de document :
Article dans une revue
Multimedia Tools and Applications, Springer Verlag, 2010, 48 (1), pp.123-140. 〈10.1007/s11042-009-0377-6〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-00953696
Contributeur : Laurent Besacier <>
Soumis le : vendredi 28 février 2014 - 14:54:26
Dernière modification le : jeudi 11 octobre 2018 - 08:48:04

Lien texte intégral

Identifiants

Citation

Georges Quénot, Tien-Ping Tan, Viet-Bac Le, Stéphane Ayache, Laurent Besacier, et al.. Content-based search in multilingual audiovisual documents using the International Phonetic Alphabet. Multimedia Tools and Applications, Springer Verlag, 2010, 48 (1), pp.123-140. 〈10.1007/s11042-009-0377-6〉. 〈hal-00953696〉

Partager

Métriques

Consultations de la notice

352