Semantically Enhanced Term Frequency based on Word Embeddings for Arabic Information Retrieval - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

Semantically Enhanced Term Frequency based on Word Embeddings for Arabic Information Retrieval

Résumé

Traditional Information Retrieval (IR) models are based on bag-of-words paradigm, where relevance scores are computed based on exact matching of keywords. Although these models have already achieved good performance, it has been shown that most of dissatisfaction cases in relevance are due to term mismatch between queries and documents. In this paper, we introduce novel method to compute term frequency based on semantic similarities using distributed representations of words in a vector space (Word Embeddings). Our main goal is to allow distinct but semantically related terms to match each other and contribute to the relevance scores. Hence, Arabic documents are retrieved beyond the bag-of-words paradigm based on semantic similarities between word vectors. The results on Arabic standard TREC data sets show significant improvement over the baseline bag-of-words models.
Fichier non déposé

Dates et versions

hal-01409754 , version 1 (06-12-2016)

Identifiants

  • HAL Id : hal-01409754 , version 1

Citer

Abdelkader El Mahdaouy, Saïd El Alaoui Ouatik, Eric Gaussier. Semantically Enhanced Term Frequency based on Word Embeddings for Arabic Information Retrieval. Information Science and Technology (CIST), 2016 Fourth IEEE International Colloquium, Oct 2016, Tangier, Morocco. ⟨hal-01409754⟩
101 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More