Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Optimal shrinkage for robust covariance matrix estimators in a small sample size setting

Karina Ashurbekova 1 Antoine Usseglio-Carleve 1 Florence Forbes 1 Sophie Achard 1
1 MISTIS - Modelling and Inference of Complex and Structured Stochastic Systems
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : When estimating covariance matrices, traditional sample covariance-based estimators are straightforward but suffer from two main issues: 1) a lack of robustness, which occurs as soon as the samples do not come from a Gaussian distribution or are contaminated with outliers and 2) a lack of data, which occurs as soon as the covariance matrix dimension is greater than the sample size. The first issue can be handled by assuming samples are drawn from a heavy-tailed distribution, at the cost of more complex derivations, while the second issue can be addressed by shrinkage with the difficulty of choosing the appropriate level of regularization. In this work we offer both a tractable and optimal framework based on shrinked likelihood-based M-estimators. First, a closed-form expression is provided for a regularized covariance matrix estimator with an optimal shrinkage coefficient for any sample distribution in the elliptical family. Then, a complete inference procedure is proposed which can also handle both unknown mean and tail parameter, in contrast to most existing methods that focus on the covariance matrix parameter requiring pre-set values for the others. An illustration on synthetic and real brain connectivity data is provided in the case of the t-distribution with unknown mean and degrees-of-freedom parameters.
Complete list of metadatas

Cited literature [46 references]  Display  Hide  Download
Contributor : Florence Forbes <>
Submitted on : Friday, April 24, 2020 - 9:13:50 AM
Last modification on : Tuesday, April 28, 2020 - 10:22:26 AM


Files produced by the author(s)


  • HAL Id : hal-02378034, version 2



Karina Ashurbekova, Antoine Usseglio-Carleve, Florence Forbes, Sophie Achard. Optimal shrinkage for robust covariance matrix estimators in a small sample size setting. 2020. ⟨hal-02378034v2⟩



Record views


Files downloads