Using a co-similarity approach on a large scale text categorization task

Clément Grimal (1) , Gilles Bisson (1)

1 AMA - Analyse de données, Modélisation et Apprentissage automatique [Grenoble]

This paper presents a framework we developed for the second Large Scale Hierarchical Text Categorization challenge LSHTC2. The main idea is to propose a method allowing to deal with the terms variability among the categories in order to be able to find similarities between collections of documents belonging to the same category but having few common terms. Thus, we used a co-similarity based approach, named X-Sim, that we introduced in previous work. Nevertheless, as this co-similarity methods are not highly scalable, we need to implement a "divide and conquer'' approach to split the categories into a set of clusters containing semantically related documents. This lead to a two-stage strategy for the document categorization: first, we decide in which cluster the test document belongs, and then inside the elected cluster, we perform the final categorization that is based on our co-similarity approach.

Mots clés: Categorization; text mining; large-scale database

Domaines: Apprentissage [cs.LG]; Intelligence artificielle [cs.AI]

Clément Grimal, Gilles Bisson. Using a co-similarity approach on a large scale text categorization task. MARAMI 2011 - Seconde conférence sur les Modèles et l′Analyse des Réseaux : Approches Mathématiques et Informatique, Oct 2011, Grenoble, France. 16p. ⟨hal-00743577⟩