On Empirical Tradeoffs in Large Scale Hierarchical Classification

Abstract : While multi-class categorization of documents has been of research interest for over a decade, relatively fewer approaches have been proposed for large scale taxonomies in which the number of classes range from hundreds of thousand as in Di- rectory Mozilla to over a million in Wikipedia. As a result of ever increasing number of text documents and images from various sources, there is an immense need for auto- matic classification of documents in such large hierarchies. In this paper, we analyze the tradeoffs between the impor- tant characteristics of different classifiers employed in the top down fashion. The properties for relative comparison of these classifiers include, (i) accuracy on test instance, (ii) training time (iii) size of the model and (iv) test time re- quired for prediction. Our analysis is motivated by the well known error bounds from learning theory, which is also fur- ther reinforced by the empirical observations on the publicly available data from the Large Scale Hierarchical Text Class- fication Challenge. We show that by exploiting the data het- erogenity across the large scale hierarchies, one can build an overall classification system which is approximately 4 times faster for prediction, 3 times faster to train, while sacrificing only 1% point in accuracy.
Type de document :
Communication dans un congrès
CIKM 2012 - International Conference on Information and Knowledge Management, Oct 2012, Sheraton, Maui HI, United States. 4p., 2012


https://hal.archives-ouvertes.fr/hal-00750897
Contributeur : Eric Gaussier <>
Soumis le : lundi 12 novembre 2012 - 16:19:35
Dernière modification le : mardi 28 octobre 2014 - 18:34:33
Document(s) archivé(s) le : mercredi 13 février 2013 - 03:46:24

Fichier

Babbar-Partalas-Gaussier-Ambla...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00750897, version 1

Collections

Citation

Rohit Babbar, Ioannis Partalas, Éric Gaussier, Cécile Amblard. On Empirical Tradeoffs in Large Scale Hierarchical Classification. CIKM 2012 - International Conference on Information and Knowledge Management, Oct 2012, Sheraton, Maui HI, United States. 4p., 2012. <hal-00750897>

Exporter

Partager

Métriques

Consultations de
la notice

215

Téléchargements du document

132