Annotating Multimodal data of Singing and Speaking

Coralie Vincent (1)

1 SFL - Structures Formelles du Langage

Annotating multimodal data in a widely compatible and sustainable format is challenging. However, within the last decade, considerable progress has been made through the development in academia of free and often open-source software allowing annotation of multimodal resources. After comparing three of these software packages, the use of one of them, the ELAN software, is presented. The implementation of a coding scheme is detailed. Then the full process of making annotations by a transcriber is explained. Finally, the querying of the annotations is described. As a conclusion, general recommendations regarding multimodal analysis of singing are given.

Mots clés: singing; multimodality; annotation

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]; Musique, musicologie et arts de la scène; Linguistique

Coralie Vincent. Annotating Multimodal data of Singing and Speaking. Frank A. Russo; Beatriz Ilari; Annabel J. Cohen. The Routledge Companion to Interdisciplinary Studies in Singing, I, Routledge, 2020, Development, 9781315163734. ⟨hal-01964707v2⟩