An Empirical Comparison of Supervised Ensemble Learning Approaches

Mohamed Bibimoune 1 Haytham Elghazel 1 Alex Aussem 1
1 DM2L - Data Mining and Machine Learning
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : We present an extensive empirical comparison between twenty prototypical supervised ensemble learning algorithms, including Boosting, Bagging, Random Forests, Rotation Forests, Arc-X4, Class-Switching and their variants, as well as more recent techniques like Random Patches. These algorithms were compared against each other in terms of threshold, ranking/ordering and probability metrics over nineteen UCI benchmark datasets with binary labels. We also examine the influence of two base learners, CART and Extremely Randomized Trees, and the effect of calibrating the models via Isotonic Regression on each performance metric. The selected datasets were already used in various empirical studies and cover different application domains. The experimental analysis was restricted to the hundred most relevant features according to the SNR filter method with a view to dramatically reducing the computational burden involved by the simulation. The source code and the detailed results of our study are publicly available.
Document type :
Conference papers
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01339258
Contributor : Équipe Gestionnaire Des Publications Si Liris <>
Submitted on : Wednesday, June 29, 2016 - 3:50:34 PM
Last modification on : Thursday, November 21, 2019 - 2:35:01 AM

Identifiers

  • HAL Id : hal-01339258, version 1

Citation

Mohamed Bibimoune, Haytham Elghazel, Alex Aussem. An Empirical Comparison of Supervised Ensemble Learning Approaches. International Workshop on Complex Machine Learning Problems with Ensemble Methods COPEM@ECML/PKDD'13, Sep 2013, Prague, Czech Republic. pp.123-138. ⟨hal-01339258⟩

Share

Metrics

Record views

119