A Multi-Sensor Helmet to Capture Rare Singing, an Intangible Cultural Heritage Study

Samer K. Al Kork (1) , Aurore Jaumard-Hakoun (1) , Martine Adda-Decker (2) , Angelique Amelot (2) , Lise Crevier-Buchman (2, 3) , Patrick Chawah (2) , Gérard Dreyfus (1) , Thibaut Fux (2) , Claire Pillot-Loiseau (2) , Pierre Roussel (1) , Maureen Stone (4) , Keele Xu (1) , Bruce Denby (1)

1 SIGMA - Laboratoire Signaux, Modèles et Apprentissage Statistique
2 LPP - LPP - Laboratoire de Phonétique et Phonologie - UMR 7018
3 HEGP - Hôpital Européen Georges Pompidou [APHP]
4 VTVL - Vocal Tract Visualization Lab [Baltimore]

A portable helmet based system has been developed to capture motor behavior during singing and other oral-motor functions in a non-laboratory experimental environment. The system, based on vocal tract sensing methods developed for speech production and recognition, consists of a lightweight " hyper-helmet " containing an ultrasonic (US) transducer to capture tongue movement, a video camera for the lips, and a microphone, coupled with a further sensor suite including an electroglottograph (EGG), nose-mounted accelerometer, and respiration sensor. The system has been tested on two rare, endangered singing musical styles, Corsican " Cantu in Paghjella " , and Byzantine hymns from Mount Athos, Greece. The versatility of the approach is furthermore demonstrated by capturing a contemporary singing style known as " Human Beat Box. "

Mots clés: portable speech collection system; ultrasound; EGG; accelerometer; data acquisition; intangible cultural heritage; i-Treasures project

Domaines: Linguistique

Samer K. Al Kork, Aurore Jaumard-Hakoun, Martine Adda-Decker, Angelique Amelot, Lise Crevier-Buchman, et al.. A Multi-Sensor Helmet to Capture Rare Singing, an Intangible Cultural Heritage Study. 10th International Seminar on Speech Production (ISSP), May 2014, Cologne, Germany. pp.5-8. ⟨hal-01188296⟩