HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Automatic Generation of Interactive 3D Characters and Scenes for Virtual Reality from a Single-Viewpoint 360-Degree Video

Abstract : This work addresses the problem of using real-world data captured from a single viewpoint by a low-cost 360-degree camera to create an immersive and interactive virtual reality scene. We combine different existing state-of-the-art data enhancement methods based on pre-trained deep learning models to quickly and automatically obtain 3D scenes with animated character models from a 360-degree video. We provide details on our implementation and insight on how to adapt existing methods to 360-degree inputs. We also present the results of a user study assessing the extent to which virtual agents generated by this process are perceived as present and engaging.
Complete list of metadata

Cited literature [8 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02114141
Contributor : Grégoire Dupont de Dinechin Connect in order to contact the contributor
Submitted on : Thursday, February 27, 2020 - 3:44:21 PM
Last modification on : Wednesday, November 17, 2021 - 12:31:08 PM

File

deDinechinPaljic2019Automatic....
Files produced by the author(s)

Identifiers

Citation

Grégoire Dupont de Dinechin, Alexis Paljic. Automatic Generation of Interactive 3D Characters and Scenes for Virtual Reality from a Single-Viewpoint 360-Degree Video. 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Mar 2019, Osaka, Japan. ⟨10.1109/vr.2019.8797969⟩. ⟨hal-02114141v2⟩

Share

Metrics

Record views

123

Files downloads

178