Semantic Similarity of Arabic Sentences with Word Embeddings

Abstract : Semantic textual similarity is the basis of countless applications and plays an important role in diverse areas, such as information retrieval, plagiarism detection, information extraction and machine translation. This article proposes an innovative word embedding-based system devoted to calculate the semantic similarity in Arabic sentences. The main idea is to exploit vectors as word representations in a multidi-mensional space in order to capture the semantic and syntactic properties of words. IDF weighting and Part-of-Speech tagging are applied on the examined sentences to support the identification of words that are highly descriptive in each sentence. The performance of our proposed system is confirmed through the Pearson correlation between our assigned semantic similarity scores and human judgments.
Liste complète des métadonnées

Cited literature [34 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01683485
Contributor : Didier Schwab <>
Submitted on : Monday, January 15, 2018 - 3:43:07 PM
Last modification on : Tuesday, February 12, 2019 - 1:31:11 AM
Document(s) archivé(s) le : Monday, May 7, 2018 - 11:30:20 AM

File

W17-1303.pdf
Publisher files allowed on an open archive

Identifiers

  • HAL Id : hal-01683485, version 1

Collections

Citation

El Moatez Billah Nagoudi, Didier Schwab. Semantic Similarity of Arabic Sentences with Word Embeddings. Third Arabic Natural Language Processing Workshop, Apr 2017, Valencia, France. pp.18 - 24. ⟨hal-01683485⟩

Share

Metrics

Record views

264

Files downloads

240