PROJET - Spatial Audio Separation Using Projections

Abstract : We propose a projection-based method for the unmixing of multi-channel audio signals into their different constituent spatial objects. Here, spatial objects are modelled using a unified framework which handles both point sources and diffuse sources. We then propose a novel methodology to estimate and take advantage of the spatial dependencies of an object. Where previous research has processed the original multichannel mixtures directly and has been principally focused on the use of inter-channel covariance structures, here we instead process projections of the multichannel signal on many different spatial directions. These linear combinations consist of observations where some spatial objects are cancelled or enhanced. We then propose an algorithm which takes these projections as the observations, discarding dependencies between them. Since each one contains global information regarding all channels of the original multichannel mixture, this provides an effective means of learning the parameters of the original audio, while avoiding the need for joint-processing of all the channels. We further show how to recover the separated spatial objects and demonstrate the use of the technique on stereophonic music signals.
Type de document :
Communication dans un congrès
41st International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016, Shanghai, China. IEEE, Proceedings of the 41st International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016
Liste complète des métadonnées

Littérature citée [37 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01248014
Contributeur : Roland Badeau <>
Soumis le : mercredi 27 janvier 2016 - 09:53:47
Dernière modification le : mercredi 20 février 2019 - 14:41:18
Document(s) archivé(s) le : vendredi 11 novembre 2016 - 16:34:06

Fichier

Projet_ICASSP_SaS.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01248014, version 1

Citation

Derry Fitzgerald, Antoine Liutkus, Roland Badeau. PROJET - Spatial Audio Separation Using Projections. 41st International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016, Shanghai, China. IEEE, Proceedings of the 41st International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2016. 〈hal-01248014〉

Partager

Métriques

Consultations de la notice

640

Téléchargements de fichiers

517