Impact of subsampling and pruning on random forests

Abstract : Random forests are ensemble learning methods introduced by Breiman (2001) that operate by averaging several decision trees built on a randomly selected subspace of the data set. Despite their widespread use in practice, the respective roles of the different mechanisms at work in Breiman's forests are not yet fully understood, neither is the tuning of the corresponding parameters. In this paper, we study the influence of two parameters , namely the subsampling rate and the tree depth, on Breiman's forests performance. More precisely, we show that fully developed sub-sampled forests and pruned (without subsampling) forests have similar performances, as long as respective parameters are well chosen. Moreover, experiments show that a proper tuning of subsampling or pruning lead in most cases to an improvement of Breiman's original forests errors.
Type de document :
Pré-publication, Document de travail
2016
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01287521
Contributeur : Erwan Scornet <>
Soumis le : vendredi 24 novembre 2017 - 20:14:24
Dernière modification le : samedi 24 novembre 2018 - 01:44:22

Fichier

Identifiants

  • HAL Id : hal-01287521, version 2
  • ARXIV : 1603.04261

Collections

Citation

Roxane Duroux, Erwan Scornet. Impact of subsampling and pruning on random forests. 2016. 〈hal-01287521v2〉

Partager

Métriques

Consultations de la notice

34

Téléchargements de fichiers

1