P. Alquier, PAC-Bayesian bounds for randomized empirical risk minimizers, Mathematical Methods of Statistics, vol.17, issue.4, pp.279-304, 2008.
DOI : 10.3103/S1066530708040017
URL : https://hal.archives-ouvertes.fr/hal-00354922

J. Audibert, A better variance control for PAC-Bayesian classification, Preprint n.905, Laboratoire de Probabilités et Modèles Aléatoires, 2004.

J. Audibert, Fast learning rates in statistical inference through aggregation, The Annals of Statistics, vol.37, issue.4, 2009.
DOI : 10.1214/08-AOS623
URL : https://hal.archives-ouvertes.fr/hal-00139030

L. Peter, O. Bartlett, S. Bousquet, and . Mendelson, Local rademacher complexities, Annals of Statistics, vol.33, issue.4, pp.1497-1537, 2005.

L. Birgé and P. Massart, Minimum Contrast Estimators on Sieves: Exponential Bounds and Rates of Convergence, Bernoulli, vol.4, issue.3, pp.329-375, 1998.
DOI : 10.2307/3318720

A. Caponnetto and E. Vito, Optimal rates for the regularized leastsquares algorithm, Found. Comput. Math, pp.331-368, 2007.

O. Catoni, A PAC-Bayesian approach to adaptive classification, 2003.

O. Catoni, Statistical Learning Theory and Stochastic Optimization, Lectures on Probability Theory and Statistics, ´ Ecole d' ´ Eté de Probabilités de Saint-Flour XXXI ?, Lecture Notes in Mathematics, vol.1851, 2001.

O. Catoni, Pac-Bayesian Supervised Classification: The Thermodynamics of Statistical Learning, IMS Lecture Notes Monograph Series. Institute of Mathematical Statistics, vol.56, pp.1-163, 2007.
URL : https://hal.archives-ouvertes.fr/hal-00206119

O. Catoni, High confidence estimates of the mean of heavy-tailed real random variables. submitted to Ann, Probab. Stat, 2009.
URL : https://hal.archives-ouvertes.fr/hal-00423460

L. Györfi, M. Kohler, A. Krzy?, and H. Walk, A Distribution-Free Theory of Nonparametric Regression, 2004.
DOI : 10.1007/b97848

A. E. Hoerl, Application of ridge analysis to regression problems, Chem. Eng. Prog, vol.58, pp.54-59, 1962.

V. Koltchinskii, Local Rademacher complexities and oracle inequalities in risk minimization, The Annals of Statistics, vol.34, issue.6, pp.2593-2656, 2006.
DOI : 10.1214/009053606000001019

J. Langford and J. Shawe-taylor, PAC-bayes & margins, Advances in Neural Information Processing Systems, pp.423-430, 2002.

K. Levenberg, A method for the solution of certain non-linear problems in least squares, Quarterly of Applied Mathematics, vol.2, issue.2, pp.164-168, 1944.
DOI : 10.1090/qam/10666

G. G. Lorentz, Metric entropy and approximation, Bulletin of the American Mathematical Society, vol.72, issue.6, pp.903-937, 1966.
DOI : 10.1090/S0002-9904-1966-11586-0
URL : http://projecteuclid.org/download/pdf_1/euclid.bams/1183528486

A. Nemirovski, Lectures on probability theory and statistics. Part II: topics in Non-parametric statistics, 1998.

J. Riley, Solving Systems of Linear Equations With a Positive Definite, Symmetric, but Possibly Ill-Conditioned Matrix, Mathematical Tables and Other Aids to Computation, vol.9, issue.51, pp.96-101, 1955.
DOI : 10.2307/2002065

R. Tibshirani, Regression shrinkage and selection via the lasso, J. Roy. Stat. Soc. B, vol.58, pp.267-288, 1994.

A. B. Tsybakov, Optimal Rates of Aggregation, Computational Learning Theory and Kernel Machines, pp.303-313, 2003.
DOI : 10.1007/978-3-540-45167-9_23
URL : https://hal.archives-ouvertes.fr/hal-00104867

Y. Yang, Aggregating regression procedures to improve performance, Bernoulli, vol.10, issue.1, pp.25-47, 2004.
DOI : 10.3150/bj/1077544602