Forest-RK: A New Random Forest Induction Method - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2008

Forest-RK: A New Random Forest Induction Method

Simon Bernard
Laurent Heutte

Résumé

In this paper we present our work on the parametrization of Random Forests (RF), and more particularly on the number K of features randomly selected at each node during the tree induction process. It has been shown that this hyperparameter can play a significant role on performance. However, the choice of the value of K is usually made either by a greedy search that tests every possible value to choose the optimal one, either by choosing a priori one of the three arbitrary values commonly used in the literature. With this work we show that none of those three values is always better than the others. We thus propose an alternative to those arbitrary choices of K with a new ”push-button” RF induction method, called Forest-RK, for which K is not an hyperparameter anymore. Our experimentations show that this new method is at least as statistically accurate as the original RF method with a default K setting.
Fichier principal
Vignette du fichier
icic08.pdf (93.21 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00436367 , version 1 (26-11-2009)

Identifiants

Citer

Simon Bernard, Laurent Heutte, Sébastien Adam. Forest-RK: A New Random Forest Induction Method. 4th International Conference on Intelligent Computing (ICIC), Sep 2008, Shanghai, China. pp.430-437, ⟨10.1007/978-3-540-85984-0_52⟩. ⟨hal-00436367⟩
3276 Consultations
1521 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More