Report on INEX 2013

Patrice Bellot (1) , Antoine Doucet (2) , Shlomo Geva (3) , Sairam Gurajada (4) , Jaap Kamps (5) , Gabriella Kazai (6) , Marijn Koolen (5) , Arunav Mishra (4) , Véronique Moriceau (7) , Matthew Trappett (3) , Josiane Mothe (8, 9) , Michael Preminger (10) , Eric San Juan (11) , Ralf Schenkel (12) , Xavier Tannier (13) , Martin Theobald (14) , Andrew Trotman (15) , Mark Sanderson (16) , Falk Scholer (16) , Qiuyue Wang (17)

1 LSIS - Laboratoire des Sciences de l'Information et des Systèmes
2 ULR - La Rochelle Université
3 QUT - Queensland University of Technology [Brisbane]
4 MPII - Max-Planck-Institut für Informatik
5 UvA - University of Amsterdam [Amsterdam] = Universiteit van Amsterdam
6 Semion Ltd (London, UK)
7 IRIT-MELODI - MEthodes et ingénierie des Langues, des Ontologies et du DIscours
8 IRIT-SIG - Systèmes d’Informations Généralisées
9 UT2J - Université Toulouse - Jean Jaurès
10 HiOA - Oslo and Akershus University College of Applied Sciences [Oslo]
11 AU - Avignon Université
12 Trier University
13 UP11 - Université Paris-Sud - Paris 11
14 Universität Ulm - Ulm University [Ulm, Allemagne]
15 University of Otago [Dunedin, Nouvelle-Zélande]
16 RMIT University - Royal Melbourne Institute of Technology University
17 Renmin University of China, Beijing

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2013 evaluation campaign, which consisted of four activities addressing three themes: searching professional and user generated data (Social Book Search track); searching structured or semantic data (Linked Data track); and focused retrieval (Snippet Retrieval and Tweet Contextualization tracks). INEX 2013 was an exciting year for INEX in which we consolidated the collaboration with (other activities in) CLEF and for the second time ran our workshop as part of the CLEF labs in order to facilitate knowledge transfer between the evaluation forums. This paper gives an overview of all the INEX 2013 tracks, their aims and task, the built test-collections, and gives an initial analysis of the results.

Mots clés: SIGEVI

Domaines: Théorie de l'information [cs.IT]; Recherche d'information [cs.IR]

Patrice Bellot, Antoine Doucet, Shlomo Geva, Sairam Gurajada, Jaap Kamps, et al.. Report on INEX 2013. Sigir Forum, 2013, 47 (2), pp.21-32. ⟨10.1145/2568388.2568393⟩. ⟨hal-01447807⟩