Dynamic Adaptive Mesh Streaming for Real-time 3D Teleimmersion

Simon Crowle (1) , Alexandros Doumanoglou (2) , Benjamin Poussard (3) , Michael Boniface (1) , Dimitrios Zarpalas (2) , Petros Daras (2)

1 University of Southampton
2 University of Thessaloniki
3 LAMPA - Laboratoire Angevin de Mécanique, Procédés et InnovAtion

Recent advances in full body 3D reconstruction methods have lead to the realisation of high quality, real-time, photo realistic capture of users in a range of tele-immersion (TI) contexts including gaming and mixed reality environments. The full body reconstruction (FBR) process is computationally expensive requiring comparatively high CPU, GPU and network resources in order to maintain a shared, virtual reality in which high quality 3D reproductions of users can be rendered in real-time. A significant optimisation of the delivery of FBR content has been achieved through the realtime compression and de-compression of 3D geometry and textures. Here we present a new, adaptive compression methodology that allows a TI system called 3D-LIVE to modify the quality and speed of a FBR TI pipeline based on the data carrying capability of the network. Our rule-based adaptation strategy uses network performance sampling processes and a configurable rule engine to dynamically alter the compression of FBR reconstruction on-the-fly. We demonstrate the efficacy of the approach with an experimental evaluation of system and conclude with a discussion of future directions for adaptive FBR compression.

Mots clés: adaptive compression; QoS; content adaptation; network monitoring

Domaines: Sciences de l'information et de la communication

Simon Crowle, Alexandros Doumanoglou, Benjamin Poussard, Michael Boniface, Dimitrios Zarpalas, et al.. Dynamic Adaptive Mesh Streaming for Real-time 3D Teleimmersion. 20th International Conference on Web 3D Technology, Jun 2015, Heraklion, Crete, Greece. pp.269-277, ⟨10.1145/2775292.2775296⟩. ⟨hal-01169990⟩