Handwritten Music Object Detection: Open Issues and Baseline Results

Alexander Pacha (1) , Kwon-Young Choi (2) , Bertrand B. Coüasnon (3) , Yann Ricquebourg (2) , Richard Zanibbi (1) , Horst Eidenberger (1)

1 Institute for Software Technology and Interactive Systems, TU Wien, Vienna, Austria
2 IntuiDoc - intuitive user interaction for document
3 INSA Rennes - Institut National des Sciences Appliquées - Rennes

Optical Music Recognition (OMR) is the challenge of understanding the content of musical scores. Accurate detection of individual music objects is a critical step in processing musical documents, because a failure at this stage corrupts any further processing. So far, all proposed methods were either limited to typeset music scores or were built to detect only a subset of the available classes of music symbols. In this work, we propose an end-to-end trainable object detector for music symbols that is capable of detecting almost the full vocabulary of modern music notation in handwritten music scores. By training deep convolutional neural networks on the recently released MUSCIMA++ dataset which has symbol-level annotations, we show that a machine learning approach can be used to accurately detect music objects with a mean average precision of up to 80%.

Mots clés: Optical Music Recognition; Object Detection; Handwritten Scores; Deep Learning

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Traitement du texte et du document; Réseau de neurones [cs.NE]

Alexander Pacha, Kwon-Young Choi, Bertrand B. Coüasnon, Yann Ricquebourg, Richard Zanibbi, et al.. Handwritten Music Object Detection: Open Issues and Baseline Results. 13th IAPR International Workshop on Document Analysis Systems, Apr 2018, Vienne, Austria. ⟨hal-01972424⟩