An Iterative Bayesian Algorithm for Sparse Component Analysis in Presence of Noise

Abstract : We present a Bayesian approach for Sparse Component Analysis (SCA) in the noisy case. The algorithm is essentially a method for obtaining sufficiently sparse solutions of underdetermined systems of linear equations with additive Gaussian noise. In general, an underdetermined system of linear equations has infinitely many solutions. However, it has been shown that sufficiently sparse solutions can be uniquely identified. Our main objective is to find this unique solution. Our method is based on a novel estimation of source parameters and maximum a posteriori (MAP) estimation of sources. To tackle the great complexity of the MAP algorithm (when the number of sources and mixtures become large), we propose an Iterative Bayesian Algorithm (IBA). This IBA algorithm is based on the MAP estimation of sources, too, but optimized with a steepest-ascent method. The convergence analysis of the IBA algorithm and its convergence to true global maximum are also proved. Simulation results show that the performance achieved by the IBA algorithm is among the best, while its complexity is rather high in comparison to other algorithms. Simulation results also show the low sensitivity of the IBA algorithm to its simulation parameters.
Complete list of metadatas

Cited literature [45 references]  Display  Hide  Download
Contributor : Christian Jutten <>
Submitted on : Thursday, October 29, 2009 - 2:58:19 PM
Last modification on : Tuesday, July 9, 2019 - 1:21:28 AM
Long-term archiving on : Thursday, June 17, 2010 - 5:29:01 PM


Publisher files allowed on an open archive



Hadi Zayyani, Massoud Babaie-Zadeh, Christian Jutten. An Iterative Bayesian Algorithm for Sparse Component Analysis in Presence of Noise. IEEE Transactions on Signal Processing, Institute of Electrical and Electronics Engineers, 2009, 57 (11), pp.4378-4390. ⟨10.1109/TSP.2009.2025154⟩. ⟨hal-00428706⟩



Record views


Files downloads