Skip to Main content Skip to Navigation
New interface
Conference papers

Neural text generation for query expansion in information retrieval

Vincent Claveau 1 
1 LinkMedia - Creating and exploiting explicit links between multimedia fragments
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
Abstract : Expanding users' query is a well-known way to improve the performance of document retrieval systems. Several approaches have been proposed in the literature, and some of them are considered as yielding state-of-the-art results in Information Retrieval. In this paper, we explore the use of text generation to automatically expand the queries. We rely on a well-known neural generative model, OpenAI's GPT-2, that comes with pre-trained models for English but can also be fine-tuned on specific corpora. Through different experiments and several datasets, we show that text generation is a very effective way to improve the performance of an IR system, with a large margin (+10 %MAP gains), and that it outperforms strong baselines also relying on query expansion (RM3). This conceptually simple approach can easily be implemented on any IR system thanks to the availability of GPT code and models.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03494692
Contributor : Vincent Claveau Connect in order to contact the contributor
Submitted on : Tuesday, December 21, 2021 - 2:10:21 PM
Last modification on : Friday, August 5, 2022 - 2:54:52 PM
Long-term archiving on: : Tuesday, March 22, 2022 - 6:35:29 PM

File

Claveau_GPT4IR_WI2021.pdf
Files produced by the author(s)

Identifiers

Citation

Vincent Claveau. Neural text generation for query expansion in information retrieval. WI-IAT 2021 - 20th IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, Dec 2021, Melbourne, Australia. pp.1-8, ⟨10.1145/3486622.3493957⟩. ⟨hal-03494692⟩

Share

Metrics

Record views

100

Files downloads

132