Skip to Main content Skip to Navigation
Conference papers

Learning to Rank System Configurations

Abstract : Information Retrieval (IR) systems heavily rely on a large number of parameters, such as the retrieval model or various query expansion parameters, whose values greatly in uence the overall retrieval effectiveness. However, setting all these parameters individually can often be a tedious task, since they can all affect one another, while also vary for different queries. We propose to tackle this problem by dealing with entire system configurations (i.e. a set of parameters representing an IR system) instead of single parameters, and to apply state-of-the-art Learning to Rank techniques to select the most appropriate configuration for a given query. The experiments we conducted on two TREC AdHoc collections show that this approach is feasible and significantly outperforms the traditional way to configure a system using grid search, as well as the top performing systems of the TREC tracks. We also show an analysis on the impact of different groups of parameters on retrieval effectiveness.
Complete list of metadatas

Cited literature [14 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01682971
Contributor : Open Archive Toulouse Archive Ouverte (oatao) <>
Submitted on : Friday, January 12, 2018 - 4:22:19 PM
Last modification on : Tuesday, September 8, 2020 - 10:42:05 AM
Long-term archiving on: : Tuesday, May 8, 2018 - 12:05:44 AM

File

deveaud_18777.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01682971, version 1
  • OATAO : 18777

Citation

Romain Deveaud, Josiane Mothe, Jian-Yun Nie. Learning to Rank System Configurations. 25th ACM International Conference on Information and Knowledge Management (CIKM 2016), Oct 2016, Indianapolis, United States. pp. 2001-2004. ⟨hal-01682971⟩

Share

Metrics

Record views

128

Files downloads

264