One class random forests

Chesner Désir (1, 2) , Simon Bernard (1) , Caroline Petitjean (1, 2) , Heutte Laurent (1)

1 DocApp - LITIS - Equipe Apprentissage
2 QuantIF-LITIS - Equipe Quantification en Imagerie Fonctionnelle

One class classification is a binary classification task for which only one class of samples is available for learning. In some preliminary works, we have proposed One Class Random Forests (OCRF), a method based on a random forest algorithm and an original outlier generation procedure that makes use of classifier ensemble randomization principles. In this paper, we propose an extensive study of the behavior of OCRF, that includes experiments on various UCI public datasets and comparison to reference one class namely, Gaussian density models, Parzen estimators, Gaussian mixture models and One Class SVMs--with statistical significance. Our aim is to show that the randomization principles embedded in a random forest algorithm make the outlier generation process more efficient, and allow in particular to break the curse of dimensionality. One Class Random Forests are shown to perform well in comparison to other methods, and in particular to maintain stable performance in higher dimension, while the other algorithms may fail.

Domaines: Apprentissage [cs.LG]

Chesner Désir, Simon Bernard, Caroline Petitjean, Heutte Laurent. One class random forests. Pattern Recognition, 2013, 46 (12), pp.3490-3506. ⟨10.1016/j.patcog.2013.05.022⟩. ⟨hal-00862706⟩