Word sense discrimination in information retrieval: a spectral clustering-based approach

Adrian-Gabriel Chifu (1) , Florentina Hristea (2) , Josiane Mothe (1, 3) , Marius Popescu (2)

1 IRIT-SIG - Systèmes d’Informations Généralisées
2 UniBuc - University of Bucharest
3 UT2J - Université Toulouse - Jean Jaurès

Word sense ambiguity has been identified as a cause of poor precision in information retrieval (IR) systems. Word sense disambiguation and discrimination methods have been defined to help systems choose which documents should be retrieved in relation to an ambiguous query. However, the only approaches that show a genuine benefit for word sense discrimination or disambiguation in IR are generally supervised ones. In this paper we propose a new unsupervised method that uses word sense discrimination in IR. The method we develop is based on spectral clustering and reorders an initially retrieved document list by boosting documents that are semantically similar to the target query. For several TREC ad hoc collections we show that our method is useful in the case of queries which contain ambiguous terms. We are interested in improving the level of precision after 5, 10 and 30 retrieved documents (P@5, P@10, P@30) respectively. We show that precision can be improved by 8% above current state-of-the-art baselines. We also focus on poor performing queries.

Mots clés: Information retrieval; Word sense disambiguation; Word sense discrimination; Spectral clustering; High precision

Domaines: Théorie de l'information [cs.IT]; Recherche d'information [cs.IR]

Adrian-Gabriel Chifu, Florentina Hristea, Josiane Mothe, Marius Popescu. Word sense discrimination in information retrieval: a spectral clustering-based approach. Information Processing and Management, 2014, vol. 51 (n° 2), pp. 16-31. ⟨10.1016/j.ipm.2014.10.007⟩. ⟨hal-01153775⟩