Informed source separation of linear instantaneous under-determined audio mixtures by source index embedding

Mathieu Parvaix 1 Laurent Girin 1
1 GIPSA-MAGIC - MAGIC
GIPSA-DPC - Département Parole et Cognition
Abstract : In this paper, we address the issue of underdeter- mined source separation of I non-stationary audio sources from a J-channel linear instantaneous mixture (J < I). This problem is addressed with a specific coder-decoder configuration. At the coder, source signals are assumed to be available before the mixing is processed. A time-frequency (TF) joint analysis of each source signal and mixture signal enables to select the subset of sources (among I) leading to the best separation results in each TF region. A corresponding source(s) index code is imperceptibly embedded into the mix signal using a watermarking technique. At the decoder, where the original source signals are unknown, the extraction of the watermark enables to invert the mixture in each TF region to recover the source signals. With such informed approach, it is shown that 5 instruments and singing voice signals can be efficiently separated from 2-channel stereo mixtures, with a quality that significantly overcomes the quality obtained by a semi-blind reference method and enables separate manipulation of the source signals during stereo music restitution (i.e. remixing).
Complete list of metadatas

Cited literature [27 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00695763
Contributor : Laurent Girin <>
Submitted on : Wednesday, May 9, 2012 - 5:43:17 PM
Last modification on : Monday, April 9, 2018 - 12:22:33 PM
Long-term archiving on : Friday, August 10, 2012 - 2:27:42 AM

File

IEEE_TASLP_2011_MP_LG_final.pd...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00695763, version 1

Citation

Mathieu Parvaix, Laurent Girin. Informed source separation of linear instantaneous under-determined audio mixtures by source index embedding. IEEE Transactions on Audio, Speech and Language Processing, Institute of Electrical and Electronics Engineers, 2011, 19 (6), pp.1721-1733. ⟨hal-00695763⟩

Share

Metrics

Record views

355

Files downloads

321