An Information Theoretic Approach to Automatic Query Expansion

Abstract : Techniques for automatic query expansion from top retrieved documents have shown promise for improving retrieval effectiveness on large collections; however, they often rely on an empirical ground, and there is a shortage of cross-system comparisons. Using ideas from Information Theory, we present a computationally simple and theoretically justified method for assigning scores to candidate expansion terms. Such scores are used to select and weight expansion terms within Rocchio's framework for query reweigthing. We compare ranking with information-theoretic query expansion versus ranking with other query expansion techniques, showing that the former achieves better retrieval effectiveness on several performance measures. We also discuss the effect on retrieval effectiveness of the main parameters involved in automatic query expansion, such as data sparseness, query difficulty, number of selected documents, and number of selected terms, pointing out interesting relationships.
Keywords : Query expansion
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01392277
Contributor : Brigitte Bigi <>
Submitted on : Friday, November 4, 2016 - 11:18:14 AM
Last modification on : Saturday, March 23, 2019 - 1:22:13 AM

Identifiers

  • HAL Id : hal-01392277, version 1

Collections

Citation

Claudio Carpineto, Renato de Mori, Giovanni Romano, Brigitte Bigi. An Information Theoretic Approach to Automatic Query Expansion. ACM Transactions on Information Systems, Association for Computing Machinery, 2001, 19 (1), http://dl.acm.org/citation.cfm?doid=366836.366860. ⟨hal-01392277⟩

Share

Metrics

Record views

96