Low Complexity Regularization of Linear Inverse Problems

Samuel Vaiter 1 Gabriel Peyré 1 Jalal M. Fadili 2
2 Equipe Image - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen
Abstract : Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for recovering the unknown signal is to solve a convex optimization problem that enforces some prior knowledge about its structure. This has proved efficient in many problems routinely encountered in imaging sciences, statistics and machine learning. This chapter delivers a review of recent advances in the field where the regularization prior promotes solutions conforming to some notion of simplicity/low-complexity. These priors encompass as popular examples sparsity and group sparsity (to capture the compressibility of natural signals and images), total variation and analysis sparsity (to promote piecewise regularity), and low-rank (as natural extension of sparsity to matrix-valued data). Our aim is to provide a unified treatment of all these regularizations under a single umbrella, namely the theory of partial smoothness. This framework is very general and accommodates all low-complexity regularizers just mentioned, as well as many others. Partial smoothness turns out to be the canonical way to encode low-dimensional models that can be linear spaces or more general smooth manifolds. This review is intended to serve as a one stop shop toward the understanding of the theoretical properties of the so-regularized solutions. It covers a large spectrum including: (i) recovery guarantees and stability to noise, both in terms of $\ell^2$-stability and model (manifold) identification; (ii) sensitivity analysis to perturbations of the parameters involved (in particular the observations), with applications to unbiased risk estimation ; (iii) convergence properties of the forward-backward proximal splitting scheme, that is particularly well suited to solve the corresponding large-scale regularized optimization problem.
Liste complète des métadonnées

Contributor : Yvain Queau <>
Submitted on : Wednesday, May 20, 2015 - 9:25:05 PM
Last modification on : Thursday, February 7, 2019 - 5:36:59 PM
Document(s) archivé(s) le : Monday, September 14, 2015 - 6:10:45 PM


Files produced by the author(s)



Samuel Vaiter, Gabriel Peyré, Jalal M. Fadili. Low Complexity Regularization of Linear Inverse Problems. Sampling Theory, a Renaissance, Pfander, Götz E. (Ed.), 50 p., 2015, 978-3-319-19748-7. ⟨10.1007/978-3-319-19749-4⟩. ⟨hal-01018927v3⟩



Record views


Files downloads