DATA CLEANSING WITH CONTRASTIVE LEARNING FOR VOCAL NOTE EVENT ANNOTATIONS

Gabriel Meseguer-Brocal (1, 2) , Rachel Bittner (3) , Simon Durand (3) , Brian Brost (3)

1 IRCAM - Institut de Recherche et Coordination Acoustique/Musique
2 Analyse et synthèse sonores [Paris]
3 SPOTIFY [London]

Data cleansing is a well studied strategy for cleaning erroneous labels in datasets, which has not yet been widely adopted in Music Information Retrieval. Previously proposed data cleansing models do not consider structured (e.g. time varying) labels, such as those common to music data. We propose a novel data cleansing model for timevarying, structured labels which exploits the local structure of the labels, and demonstrate its usefulness for vocal note event annotations in music. We frame the problem as an instance of contrastive learning, where we train a model to predict if an audio-annotation pair is a match or not. We generate training data for this model by automatically deforming known correct annotations to form incorrect annotations. We demonstrate that the accuracy of a transcription model improves greatly when trained using our proposed strategy compared with the accuracy when trained using the original dataset. Additionally we use our model to estimate the annotation error rates in the DALI dataset, and highlight other potential uses for this type of model.

Domaines: Informatique [cs]; Base de données [cs.DB]; Apprentissage [cs.LG]; Son [cs.SD]

Gabriel Meseguer-Brocal, Rachel Bittner, Simon Durand, Brian Brost. DATA CLEANSING WITH CONTRASTIVE LEARNING FOR VOCAL NOTE EVENT ANNOTATIONS. Proceedings of the 21st International Society for Music Information Retrieval Conference, Oct 2020, Montréal (virtual), Canada. ⟨hal-03200153⟩