Sparse Support Recovery with Non-smooth Loss Functions

Abstract : In this paper, we study the support recovery guarantees of underdetermined sparse regression using the 1-norm as a regularizer and a non-smooth loss function for data fidelity. More precisely, we focus in detail on the cases of 1 and ∞ losses, and contrast them with the usual 2 loss. While these losses are routinely used to account for either sparse (1 loss) or uniform (∞ loss) noise models, a theoretical analysis of their performance is still lacking. In this article, we extend the existing theory from the smooth 2 case to these non-smooth cases. We derive a sharp condition which ensures that the support of the vector to recover is stable to small additive noise in the observations, as long as the loss constraint size is tuned proportionally to the noise level. A distinctive feature of our theory is that it also explains what happens when the support is unstable. While the support is not stable anymore, we identify an " extended support " and show that this extended support is stable to small additive noise. To exemplify the usefulness of our theory, we give a detailed numerical analysis of the support stability/instability of compressed sensing recovery with these different losses. This highlights different parameter regimes, ranging from total support stability to progressively increasing support instability.
Complete list of metadatas

Cited literature [19 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01658855
Contributor : Jalal Fadili <>
Submitted on : Thursday, December 7, 2017 - 7:45:49 PM
Last modification on : Tuesday, April 30, 2019 - 1:08:50 PM

File

nipssparsistency.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01658855, version 1

Citation

Kévin Degraux, Gabriel Peyré, Jalal M. Fadili, Laurent Jacques. Sparse Support Recovery with Non-smooth Loss Functions. Advances in Neural Information Processing Systems (NIPS), Nov 2015, Barcelone, Spain. ⟨hal-01658855⟩

Share

Metrics

Record views

3237

Files downloads

30