A Fast Approach for Overcomplete Sparse Decomposition Based on Smoothed L-0 Norm

G. Hosein Mohimani (1) , Massoud Babaie-Zadeh (1) , Christian Jutten (2)

1 EE department of SUT [Tehran] - Department of Electrical Engineering [Tehran]
2 GIPSA-SIGMAPHY - GIPSA - Signal Images Physique

In this paper, a fast algorithm for overcomplete sparse decomposition, called SL0, is proposed. The algorithm is essentially a method for obtaining sparse solutions of underdetermined systems of linear equations, and its applications include underdetermined sparse component analysis (SCA), atomic decomposition on overcomplete dictionaries, compressed sensing, and decoding real field codes. Contrary to previous methods, which usually solve this problem by minimizing the l^0 norm using linear programming (LP) techniques, our algorithm tries to directly minimize the l^0 norm. It is experimentally shown that the proposed algorithm is about two to three orders of magnitude faster than the state-of-the-art interior-point LP solvers, while providing the same (or better) accuracy.

Keywords: Atomic decomposition; blind source separation(BSS); compressed sensing; overcomplete signal representation; sparse component analysis (SCA); sparse decomposition; sparse source separation

Domains: Signal and Image processing; Signal and Image Processing

G. Hosein Mohimani, Massoud Babaie-Zadeh, Christian Jutten. A Fast Approach for Overcomplete Sparse Decomposition Based on Smoothed L-0 Norm. IEEE Transactions on Signal Processing, 2009, 57 (1), pp.289-301. ⟨10.1109/TSP.2008.2007606⟩. ⟨hal-00358113⟩