Synchronized Delivery of 3D Scenes with Audio and Video

Cyril Concolato (1, 2) , J. Le Feuvre (1, 2) , Emmanouil Potetsianakis (1, 2)

1 MM - Multimédia
2 TSI - Département Traitement du Signal et des Images

Nowadays, 3D graphics have established their presence on the web - alongside audio and video. In fact, 3D scenes are often used in conjunction with audio and video, to create virtual worlds. However, the diverse nature of these various media components raises synchronization and packaging challenges. In order to address these challenges, we propose packaging 3D scenes, with audio and video, inside MP4 containers. This way, the 3D and other media are delivered as a whole, and on the receiving end, we are able to extract and synchronize the content, from within the browser. In this paper, we explain our methodology, present an end-to-end example scenario, and its associated implementation, using open-source tools.

Mots clés: X3D; HTML5; MP4; Streaming; Synchronization

Domaines: Multimédia [cs.MM]; Synthèse d'image et réalité virtuelle [cs.GR]; Web

Cyril Concolato, J. Le Feuvre, Emmanouil Potetsianakis. Synchronized Delivery of 3D Scenes with Audio and Video. Proceedings of the Twentieth International ACM Conference on 3D Web Technologies, Jun 2015, Heraklion, Greece. ⟨10.1145/2775292.2775324⟩. ⟨hal-02412140⟩