Skip to Main content Skip to Navigation
Conference papers

Performance Analysis of Information Retrieval Systems

Abstract : It has been shown that there is not a best information retrieval system configuration which would work for any query, but rather that performance can vary from one query to another. It would be interesting if a meta-system could decide which system should process a new query by learning from the context of previously submitted queries. This paper reports a deep analysis considering more than 80,000 search engine configurations applied to 100 queries and the corresponding performance. The goal of the analysis is to identify which search engine configuration responds best to a certain type of query. We considered two approaches to define query types: one is based on query clustering according to the query performance (their difficulty), while the other approach uses various query features (including query difficulty predictors) to cluster queries. We identified two parameters that should be optimized first. An important outcome is that we could not obtain strong conclusive results; considering the large number of systems and methods we used, this result could lead to the conclusion that current query features does not fit the optimizing problem.
Complete list of metadata

Cited literature [21 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01119086
Contributor : Open Archive Toulouse Archive Ouverte (oatao) <>
Submitted on : Monday, February 23, 2015 - 9:03:48 AM
Last modification on : Wednesday, June 9, 2021 - 1:10:03 PM
Long-term archiving on: : Tuesday, May 26, 2015 - 5:41:01 PM

File

Ayter_13047.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01119086, version 1
  • OATAO : 13047

Citation

Juli Ayter, Cecile Desclaux, Adrian-Gabriel Chifu, Sébastien Dejean, Josiane Mothe. Performance Analysis of Information Retrieval Systems. 3rd Spanish Conference on Information Retrieval (CERI 2014), Jun 2014, Coruna, Spain. pp.1-12. ⟨hal-01119086⟩

Share

Metrics

Record views

262

Files downloads

847