2AIRTC: The Amharic Adhoc Information Retrieval Test Collection

Tilahun Yeshambel , Josiane Mothe (1, 2) , Yaregal Assabie

1 IRIT-SIG - Systèmes d’Informations Généralisées
2 UT2J - Université Toulouse - Jean Jaurès

Evaluation is highly important for designing, developing, and maintaining information retrieval (IR) systems. The IR community has developed shared tasks where evaluation framework, evaluation measures and test collections have been developed for different languages. Although Amharic is the official language of Ethiopia currently having an estimated population of over 110 million, it is one of the under-resourced languages and there is not yet Amharic adhoc IR test collection. In this paper, we promote the monolingual Amharic IR test collection that we built for the IR community. Following the framework of Cranfield project and TREC, the collection that we named 2AIRTC consists of 12,583 documents, 240 topics and the corresponding relevance judgments.

Mots clés: Information Retrieval; Amharic test collection; Adhoc retrieval; Evaluation; Data collection; Corpus; Under-resourced language

Domaines: Intelligence artificielle [cs.AI]; Recherche d'information [cs.IR]; Base de données [cs.DB]

Tilahun Yeshambel, Josiane Mothe, Yaregal Assabie. 2AIRTC: The Amharic Adhoc Information Retrieval Test Collection. CLEF 2020, Evangelos Kanoulas; Theodora Tsikrika; Stefanos Vrochidis; Avi Arampatzis, Sep 2020, Thessaloniki, Greece. pp.55-66. ⟨hal-02937672⟩