From Bernoulli-Gaussian deconvolution to sparse signal restoration

Abstract : Formulated as a least square problem under an $\ell_0$ constraint, sparse signal restoration is a discrete optimization problem, known to be NP complete. Classical algorithms include, by increasing cost and efficiency, Matching Pursuit (MP), Orthogonal Matching Pursuit (OMP), Orthogonal Least Squares (OLS), stepwise regression algorithms and the exhaustive search. We revisit the Single Most Likely Replacement (SMLR) algorithm, developed in the mid-80's for Bernoulli-Gaussian signal restoration. We show that the formulation of sparse signal restoration as a limit case of Bernoulli-Gaussian signal restoration leads to an $\ell_0$-penalized least square minimization problem, to which SMLR can be straightforwardly adapted. The resulting algorithm, called Single Best Replacement (SBR), can be interpreted as a forward-backward extension of OLS sharing similarities with stepwise regression algorithms. Some structural properties of SBR are put forward. A fast and stable implementation is proposed. The approach is illustrated on two inverse problems involving highly correlated dictionaries. We show that SBR is very competitive with popular sparse algorithms in terms of trade-off between accuracy and computation time.
Document type :
Journal articles
Complete list of metadatas

Cited literature [47 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00443842
Contributor : Charles Soussen <>
Submitted on : Friday, June 17, 2011 - 1:47:59 PM
Last modification on : Friday, April 26, 2019 - 8:58:14 AM
Long-term archiving on : Sunday, September 18, 2011 - 2:27:23 AM

File

single.pdf
Files produced by the author(s)

Identifiers

Citation

Charles Soussen, Jérôme Idier, David Brie, Junbo Duan. From Bernoulli-Gaussian deconvolution to sparse signal restoration. IEEE Transactions on Signal Processing, Institute of Electrical and Electronics Engineers, 2011, 59 (10), pp.4572-4584. ⟨10.1109/TSP.2011.2160633⟩. ⟨hal-00443842v4⟩

Share

Metrics

Record views

669

Files downloads

313