P. Alquier and K. Lounici, PAC-Bayesian bounds for sparse regression estimation with exponential weights, Electronic Journal of Statistics, vol.5, issue.0, pp.127-145, 2011.
DOI : 10.1214/11-EJS601
URL : https://hal.archives-ouvertes.fr/hal-00465801

E. Arias-castro and . Lounici, Variable Selection with Exponential Weights and 0 -Penalization

H. Akaike, Information theory and an extension of the maximum likelihood principle, Proc. 2nd Intern. Symp. Inf. Theory, pp.267-281, 1973.

O. Catoni, Statistical learning theory and stochastic optimization . Lectures Notes in Math, 1851.
URL : https://hal.archives-ouvertes.fr/hal-00104952

E. Chernousova, Y. Golubev, and E. Krymova, Ordered smoothers with exponential weighting, Electronic Journal of Statistics, vol.7, issue.0, pp.2395-2419, 2013.
DOI : 10.1214/13-EJS849
URL : https://hal.archives-ouvertes.fr/hal-01292430

A. Dalayan and J. Salmon, Sharp oracle inequalities for aggregation of affine estimators, The Annals of Statistics, vol.40, issue.4, pp.2327-2355, 2012.
DOI : 10.1214/12-AOS1038SUPP

A. Demmler and C. Reinsch, Oscillation matrices with spline smoothing, Numerische Mathematik, vol.17, issue.5, pp.375-382, 1975.
DOI : 10.1007/BF01437406

Y. Golubev, On universal oracle inequalities related to high-dimensional linear models, The Annals of Statistics, vol.38, issue.5, pp.2751-2780, 2010.
DOI : 10.1214/10-AOS803

G. Golubev, Exponential weighting and oracle inequalities for projection estimates. Problems of Information Transmission, pp.269-280, 2012.

A. Juditsky and A. Nemirovski, Functional aggregation for nonparametric regression, Ann. Statist, vol.28, pp.681-712, 2000.

A. Kneip, Ordered Linear Smoothers, The Annals of Statistics, vol.22, issue.2, pp.835-866, 1994.
DOI : 10.1214/aos/1176325498

G. Lecué, Simultaneous adaptation to the margin and to complexity in classification, The Annals of Statistics, vol.35, issue.4, pp.1698-1721, 2007.
DOI : 10.1214/009053607000000055

G. Leung and A. Barron, Information Theory and Mixing Least-Squares Regressions, IEEE Transactions on Information Theory, vol.52, issue.8, pp.3396-3410, 2006.
DOI : 10.1109/TIT.2006.878172

C. L. Mallows, Some comments on C p, Technometrics, vol.15, pp.661-675, 1973.

A. Nemirovski, Topics in non-parametric statistics. Lectures Notes in Math, 1738.

P. Rigollet and A. Tsybakov, Linear and convex aggregation of density estimators, Mathematical Methods of Statistics, vol.16, issue.3, pp.260-280, 2007.
DOI : 10.3103/S1066530707030052
URL : https://hal.archives-ouvertes.fr/hal-00068216

P. Rigolet and A. Tsybakov, Sparse Estimation by Exponential Weighting, Statistical Science, vol.27, issue.4, pp.558-575, 2012.
DOI : 10.1214/12-STS393

C. Stein, Estimation of the Mean of a Multivariate Normal Distribution, Proc. Prague Symp. on Asymptotic Statistics, pp.345-381, 1973.
DOI : 10.1214/aos/1176345632

Y. Yang, Combining Different Procedures for Adaptive Regression, Journal of Multivariate Analysis, vol.74, issue.1, pp.135-161, 2000.
DOI : 10.1006/jmva.1999.1884