Skip to Main content Skip to Navigation
Conference papers

Document Retrieval for Large Scale Content Analysis using Contextualized Dictionaries

Gregor Wiedemann 1, * Andreas Niekler 1, *
* Corresponding author
1 Abteilung Automatische Sprachverarbeitung, Institut für Informatik, Universtität Leipzig
NLP Group | Department of Computer Science University of Leipzig
Abstract : This paper presents a procedure to retrieve subsets of rele- vant documents from large text collections for Content Analysis, e.g. in social sciences. Document retrieval for this purpose needs to take account of the fact that analysts often cannot describe their research objective with a small set of key terms, especially when dealing with theoretical or rather abstract research interests. Instead, it is much easier to de ne a set of paradigmatic documents which re ect topics of interest as well as tar- geted manner of speech. Thus, in contrast to classic information retrieval tasks we employ manually compiled collections of reference documents to compose large queries of several hundred key terms, called dictionar- ies. We extract dictionaries via Topic Models and also use co-occurrence data from reference collections. Evaluations show that the procedure im- proves retrieval results for this purpose compared to alternative methods of key term extraction as well as neglecting co-occurrence data.
Document type :
Conference papers
Complete list of metadata

Cited literature [18 references]  Display  Hide  Download
Contributor : Hélène Lowinger Connect in order to contact the contributor
Submitted on : Friday, June 13, 2014 - 2:07:29 PM
Last modification on : Monday, October 13, 2014 - 3:43:25 PM
Long-term archiving on: : Saturday, September 13, 2014 - 11:15:21 AM


Files produced by the author(s)


  • HAL Id : hal-01005879, version 1



Gregor Wiedemann, Andreas Niekler. Document Retrieval for Large Scale Content Analysis using Contextualized Dictionaries. Terminology and Knowledge Engineering 2014, Jun 2014, Berlin, Germany. 10 p. ⟨hal-01005879⟩



Record views


Files downloads