Reducing Interference with Phase Recovery in DNN-based Monaural Singing Voice Separation

Paul Magron (1) , Konstantinos Drossos (1) , Stylianos Ioannis Mimilakis (2) , Tuomas Virtanen (1)

1 TUT - Tampere University of Technology [Tampere]
2 Fraunhofer IDMT - Fraunhofer Institute for Digital Media Technology [Ilmenau]

State-of-the-art methods for monaural singing voice separation consist in estimating the magnitude spectrum of the voice in the short-term Fourier transform (STFT) domain by means of deep neural networks (DNNs). The resulting magnitude estimate is then combined with the mixture's phase to retrieve the complex-valued STFT of the voice, which is further synthesized into a time-domain signal. However, when the sources overlap in time and frequency, the STFT phase of the voice differs from the mixture's phase, which results in interference and artifacts in the estimated signals. In this paper, we investigate on recent phase recovery algorithms that tackle this issue and can further enhance the separation quality. These algorithms exploit phase constraints that originate from a sinusoidal model or from consistency , a property that is a direct consequence of the STFT redundancy. Experiments conducted on real music songs show that those algorithms are efficient for reducing interference in the estimated voice compared to the baseline approach.

Mots clés: Monaural singing voice separation; phase recovery; deep neural networks; MaD TwinNet; Wiener filtering

Domaines: Traitement du signal et de l'image [eess.SP]

Paul Magron, Konstantinos Drossos, Stylianos Ioannis Mimilakis, Tuomas Virtanen. Reducing Interference with Phase Recovery in DNN-based Monaural Singing Voice Separation. Interspeech, Sep 2018, Hyderabad, India. ⟨hal-01741278v2⟩