Spatial Audio–Graphic Modeling for X3D

Hui Ding (1, 2) , Diemo Schwarz (1, 2) , Christian Jacquemin (1, 2) , Roland Cahen (1, 2)

1 Equipe Interactions musicales temps-réel
2 Equipe Autre (hors R&D)

In audio–graphic scenes, visual and audio modalities are synchronized in time and space, and their behaviour is determined by a common process. We present here a novel way of modeling audio–graphic content for interactive 3D scenes with the concept of sound processes and their activation through 2D or 3D profiles. Many 3D applications today support both graphical and audio effects to provide a more realistic user experience; however a common model and interchange format for interactive audio–graphic scenes is still lacking. X3D is one of the most promising formats for 3D scene representation. It is extensible and supports simple spatial audio representation and almost all basic and advanced 3D computer graphics techniques. We therefore propose an extension of the X3D standard to represent the sound process and activation profile model for providing a rich audio–graphic description in X3D.

Mots clés: corpus-based synthesis; X3D; audio-graphic modeling; sound process; topophonie

Mots clés: Informatique musicale

Domaines: Son [cs.SD]; Interface homme-machine [cs.HC]; Musique, musicologie et arts de la scène; Informatique [cs]; Traitement du signal et de l'image [eess.SP]; Apprentissage [cs.LG]; Intelligence artificielle [cs.AI]; Ingénierie assistée par ordinateur; Multimédia [cs.MM]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Autre [cs.OH]; Traitement du signal et de l'image [eess.SP]

Hui Ding, Diemo Schwarz, Christian Jacquemin, Roland Cahen. Spatial Audio–Graphic Modeling for X3D. Web3D, Jun 2011, Paris, France. pp.1-1. ⟨hal-01161293⟩