Word Embedding-Based Approaches for Measuring Semantic Similarity of Arabic-English Sentences

Abstract : Semantic Textual Similarity (STS) is an important component in many Natural Language Processing (NLP) applications, and plays an important role in diverse areas such as information retrieval, machine translation, information extraction and plagiarism detection. In this paper we propose two word embedding-based approaches devoted to measuring the semantic similarity between Arabic-English cross-language sentences. The main idea is to exploit Machine Translation (MT) and an improved word embedding representations in order to capture the syntactic and semantic properties of words. MT is used to translate English sentences into Arabic language in order to apply a classical monolingual comparison. Afterwards, two word embedding-based methods are developed to rate the semantic similarity. Additionally, Words Alignment (WA), Inverse Document Frequency (IDF) and Part-of-Speech (POS) weighting are applied on the examined sentences to support the identification of words that are most descriptive in each sentence. The performances of our approaches are evaluated on a cross-language dataset containing more than 2400 Arabic-English pairs of sentence. Moreover, the proposed methods are confirmed through the Pearson correlation between our similarity scores and human ratings.
Type de document :
Communication dans un congrès
6th International Conference on Arabic Language Processing, Oct 2017, Fez, Morocco
Liste complète des métadonnées

Littérature citée [42 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01683494
Contributeur : Didier Schwab <>
Soumis le : samedi 13 janvier 2018 - 19:34:11
Dernière modification le : jeudi 11 octobre 2018 - 08:48:03
Document(s) archivé(s) le : lundi 7 mai 2018 - 01:28:20

Fichier

Lecture_Notes_in_Computer_Scie...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01683494, version 1

Collections

Citation

El Moatez Billah Nagoudi, Jérémy Ferrero, Didier Schwab, Hadda Cherroun. Word Embedding-Based Approaches for Measuring Semantic Similarity of Arabic-English Sentences. 6th International Conference on Arabic Language Processing, Oct 2017, Fez, Morocco. 〈hal-01683494〉

Partager

Métriques

Consultations de la notice

151

Téléchargements de fichiers

233