Sequential Dynamic Classification for Large Scale Multiclass Problems

Raphael Puget 1 Nicolas Baskiotis 1 Patrick Gallinari 1
1 MLIA - Machine Learning and Information Access
LIP6 - Laboratoire d'Informatique de Paris 6
Abstract : Extreme multi-class classification concerns classification problems with very large number of classes, up to several millions. Such problems have now become quite frequent in many practical applications. Until recently, most classification methods had inference complexity at least linear in the number of classes. Several directions have been recently explored for limiting this complexity, but the challenge of learning an optimal compromise between inference complexity and classification accuracy is still largely open. We propose here a novel ensemble learning approach, where classifiers are dynamically chosen among a pre-trained set of classifiers and are iteratively combined in order to achieve an efficient trade-off between inference complexity and classification accuracy. The proposed model uses statistical bounds to discard during the inference process irrelevant classes and to choose the most informative classifier with respect to the information gathered during the previous steps. Experiments on real datasets of recent challenges show that the proposed approach is able to achieve a very high classification accuracy in comparison to baselines and recent proposed approaches for similar inference time complexity.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [30 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01207428
Contributor : Raphael Puget <>
Submitted on : Thursday, October 1, 2015 - 2:49:47 PM
Last modification on : Thursday, March 21, 2019 - 2:18:24 PM
Document(s) archivé(s) le : Saturday, January 2, 2016 - 10:20:39 AM

File

ecml15.pdf
Files produced by the author(s)

Licence


Copyright

Identifiers

  • HAL Id : hal-01207428, version 1

Citation

Raphael Puget, Nicolas Baskiotis, Patrick Gallinari. Sequential Dynamic Classification for Large Scale Multiclass Problems. Extreme Classification Workshop at ICML, Jul 2015, Lille, France. ⟨hal-01207428⟩

Share

Metrics

Record views

236

Files downloads

450