Automatic Generation of Interactive 3D Characters and Scenes for Virtual Reality from a Single-Viewpoint 360-Degree Video

Abstract : This work addresses the problem of using real-world data captured from a single viewpoint by a low-cost 360-degree camera to create an immersive and interactive virtual reality scene. We combine different existing state-of-the-art data enhancement methods based on pre-trained deep learning models to quickly and automatically obtain 3D scenes with animated character models from a 360-degree video. We provide details on our implementation and insight on how to adapt existing methods to 360-degree inputs. We also present the results of a user study assessing the extent to which virtual agents generated by this process are perceived as present and engaging.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-02114141
Contributor : Grégoire Dupont de Dinechin <>
Submitted on : Monday, April 29, 2019 - 2:02:46 PM
Last modification on : Monday, June 17, 2019 - 5:03:31 PM

Identifiers

  • HAL Id : hal-02114141, version 1

Citation

Grégoire Dupont de Dinechin, Alexis Paljic. Automatic Generation of Interactive 3D Characters and Scenes for Virtual Reality from a Single-Viewpoint 360-Degree Video. 26th IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR 2019), Mar 2019, Osaka, Japan. ⟨hal-02114141⟩

Share

Metrics

Record views

60

Files downloads

183