Improving Arabic information retrieval using word embedding similarities

Abstract : Term mismatch is a common limitation of traditional information retrieval (IR) models where relevance scores are estimated based on exact matching of documents and queries. Typically, good IR model should consider distinct but semantically similar words in the matching process. In this paper, we propose a method to incorporate word embedding (WE) semantic similarities into existing probabilistic IR models for Arabic in order to deal with term mismatch. Experiments are performed on the standard Arabic TREC collection using three neural word embedding models. The results show that extending the existing IR models improves significantly baseline bag-of-words models. Although the proposed extensions significantly outperform their baseline bag-of-words, the difference between the evaluated neural word embedding models is not statistically significant. Moreover, the overall comparison results show that our extensions significantly improve the Arabic WordNet based semantic indexing approach and three recent WE-based IR language models.
Type de document :
Article dans une revue
International Journal of Speech Technology, Springer Verlag, 2018, 21 (1), pp.121-136. 〈 https://doi.org/10.1007/s10772-018-9492-y〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01706531
Contributeur : Abdelkader El Mahdaouy <>
Soumis le : lundi 12 février 2018 - 01:38:47
Dernière modification le : jeudi 11 octobre 2018 - 08:48:05

Identifiants

  • HAL Id : hal-01706531, version 1

Collections

Citation

Abdelkader El Mahdaouy, Said El Alaoui Ouatik, Eric Gaussier. Improving Arabic information retrieval using word embedding similarities. International Journal of Speech Technology, Springer Verlag, 2018, 21 (1), pp.121-136. 〈 https://doi.org/10.1007/s10772-018-9492-y〉. 〈hal-01706531〉

Partager

Métriques

Consultations de la notice

168