Skip to Main content Skip to Navigation
Conference papers

Automatic Generation of Interactive 3D Characters and Scenes for Virtual Reality from a Single-Viewpoint 360-Degree Video

Abstract : This work addresses the problem of using real-world data captured from a single viewpoint by a low-cost 360-degree camera to create an immersive and interactive virtual reality scene. We combine different existing state-of-the-art data enhancement methods based on pre-trained deep learning models to quickly and automatically obtain 3D scenes with animated character models from a 360-degree video. We provide details on our implementation and insight on how to adapt existing methods to 360-degree inputs. We also present the results of a user study assessing the extent to which virtual agents generated by this process are perceived as present and engaging.
Complete list of metadatas

Cited literature [8 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02114141
Contributor : Grégoire Dupont de Dinechin <>
Submitted on : Thursday, February 27, 2020 - 3:44:21 PM
Last modification on : Thursday, September 24, 2020 - 5:04:02 PM

File

deDinechinPaljic2019Automatic....
Files produced by the author(s)

Identifiers

Citation

Grégoire Dupont de Dinechin, Alexis Paljic. Automatic Generation of Interactive 3D Characters and Scenes for Virtual Reality from a Single-Viewpoint 360-Degree Video. 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Mar 2019, Osaka, Japan. ⟨10.1109/vr.2019.8797969⟩. ⟨hal-02114141v2⟩

Share

Metrics

Record views

90

Files downloads

286