# Slope Heuristics: Overview and Implementation

* Corresponding author
3 SELECT - Model selection in statistical learning
Inria Saclay - Ile de France, LMO - Laboratoire de Mathématiques d'Orsay, CNRS - Centre National de la Recherche Scientifique : UMR
Abstract : Model selection is a general paradigm which includes many statistical problems. One of the most fruitful and popular approaches to carry it out is the minimization of a penalized criterion. Birgé and Massart (2006) have proposed a promising data-driven method to calibrate such criteria whose penalties are known up to a multiplicative factor: the slope heuristics''. Theoretical works validate this heuristic method in some situations and several papers report a promising practical behavior in various frameworks. The purpose of this work is twofold. First, an introduction to the slope heuristics and an overview of the theoretical and practical results about it are presented. Second, we focus on the practical difficulties occurring for applying the slope heuristics. A new practical approach is carried out and compared to the standard dimension jump method. All the practical solutions discussed in this paper in different frameworks are implemented and brought together in a Matlab graphical user interface called capushe.
Mots-clés :
Document type :
Other publications
RR-7223. RR INRIA-7223, Version 1. 2010
Domain :

Cited literature [29 references]

https://hal.archives-ouvertes.fr/hal-00461639
Contributor : Jean-Patrick Baudry <>
Submitted on : Friday, March 5, 2010 - 11:39:51 AM
Last modification on : Wednesday, March 21, 2018 - 6:56:47 PM
Document(s) archivé(s) le : Friday, June 18, 2010 - 6:59:19 PM

### File

RR-7223.pdf
Files produced by the author(s)

### Identifiers

• HAL Id : hal-00461639, version 1

### Citation

Jean-Patrick Baudry, Cathy Maugis, Bertrand Michel. Slope Heuristics: Overview and Implementation. RR-7223. RR INRIA-7223, Version 1. 2010. 〈hal-00461639〉

Record views