Nonnegative matrix factorization and spatial covariance model for under-determined reverberant audio source separation

Simon Arberet (1) , Alexey Ozerov (2) , Ngoc Q. K. Duong (2) , Emmanuel Vincent (2) , Rémi Gribonval (2) , Frédéric Bimbot (2) , Pierre Vandergheynst (1)

1 LTS2 - EPFL
2 METISS - Speech and sound data modeling and processing

We address the problem of blind audio source separation in the under-determined and convolutive case. The contribution of each source to the mixture channels in the time-frequency domain is modeled by a zero-mean Gaussian random vector with a full rank covariance matrix composed of two terms: a variance which represents the spectral properties of the source and which is modeled by a nonnegative matrix factorization (NMF) model and another full rank covariance matrix which encodes the spatial properties of the source contribution in the mixture. We address the estimation of these parameters by maximizing the likelihood of the mixture using an expectation-maximization (EM) algorithm. Theoretical propositions are corroborated by experimental studies on stereo reverberant music mixtures.

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Simon Arberet, Alexey Ozerov, Ngoc Q. K. Duong, Emmanuel Vincent, Rémi Gribonval, et al.. Nonnegative matrix factorization and spatial covariance model for under-determined reverberant audio source separation. Information Sciences Signal Processing and their Applications (ISSPA), 2010 10th International Conference on, May 2010, Kuala Lumpur, Malaysia. pp.1--4, ⟨10.1109/ISSPA.2010.5605570⟩. ⟨inria-00541436⟩