Criteria for blind source separation in post nonlinear mixtures with mutual information

Abstract : This work deals with the problem of blind source separation solved by minimization of mutual information. After having chosen a model for the mixture, we focus on two methods. One is based on the minimization of an estimation of I, the mutual information. The other one uses a minimization of an estimation of C, the mutual information after transforming all the joint entropy terms. We show the differences between these two approaches by studying statistical properties of the two estimators. In this paper, we derive the bias of the estimators of the two criteria I and C. It is shown that under the hypothesis of independence, the estimator of I is asymptotically unbiased even if the bandwidth is kept fixed, whereas with a fixed bandwidth the estimator of C is not asymptotically unbiased. Further, the minimization is achieved by a relative gradient descent method and we show the differences between criteria I and C through the expression of their relative gradients.
Complete list of metadatas

Cited literature [13 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00379402
Contributor : Christian Jutten <>
Submitted on : Tuesday, April 28, 2009 - 5:02:55 PM
Last modification on : Friday, September 6, 2019 - 3:00:06 PM
Long-term archiving on : Thursday, June 10, 2010 - 7:02:40 PM

Files

elsevier.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00379402, version 1

Collections

Citation

Sophie Achard, Dinh-Tuan Pham, Christian Jutten. Criteria for blind source separation in post nonlinear mixtures with mutual information. Signal Processing, Elsevier, 2005, 85 (5), pp.965-974. ⟨hal-00379402⟩

Share

Metrics

Record views

300

Files downloads

93