Skip to Main content Skip to Navigation
Conference papers

Document Retrieval for Large Scale Content Analysis using Contextualized Dictionaries

Gregor Wiedemann 1, * Andreas Niekler 1, *
* Corresponding author
1 Abteilung Automatische Sprachverarbeitung, Institut für Informatik, Universtität Leipzig
NLP Group | Department of Computer Science University of Leipzig
Abstract : This paper presents a procedure to retrieve subsets of rele- vant documents from large text collections for Content Analysis, e.g. in social sciences. Document retrieval for this purpose needs to take account of the fact that analysts often cannot describe their research objective with a small set of key terms, especially when dealing with theoretical or rather abstract research interests. Instead, it is much easier to de ne a set of paradigmatic documents which re ect topics of interest as well as tar- geted manner of speech. Thus, in contrast to classic information retrieval tasks we employ manually compiled collections of reference documents to compose large queries of several hundred key terms, called dictionar- ies. We extract dictionaries via Topic Models and also use co-occurrence data from reference collections. Evaluations show that the procedure im- proves retrieval results for this purpose compared to alternative methods of key term extraction as well as neglecting co-occurrence data.
Document type :
Conference papers
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01005879
Contributor : Hélène Lowinger <>
Submitted on : Friday, June 13, 2014 - 2:07:29 PM
Last modification on : Monday, October 13, 2014 - 3:43:25 PM
Long-term archiving on: : Saturday, September 13, 2014 - 11:15:21 AM

File

tm_dict_paper.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01005879, version 1

Collections

Citation

Gregor Wiedemann, Andreas Niekler. Document Retrieval for Large Scale Content Analysis using Contextualized Dictionaries. Terminology and Knowledge Engineering 2014, Jun 2014, Berlin, Germany. 10 p. ⟨hal-01005879⟩

Share

Metrics

Record views

351

Files downloads

890