Virtual Agents from 360° Video for Interactive Virtual Reality

Abstract : Creating lifelike virtual humans for interactive virtual reality is a difficult task. Most current solutions rely either on crafting synthetic character models and animations, or on capturing real people with complex camera setups. As an alternative, we propose leveraging efficient learning-based models for human mesh estimation, and applying them to the popular form of immersive content that is 360° video. We demonstrate an implementation of this approach using available pre-trained models, and present user study results that show that the virtual agents generated with this method can be made more compelling by the use of idle animations and reactive verbal and gaze behavior.
Complete list of metadatas

Cited literature [15 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02155594
Contributor : Grégoire Dupont de Dinechin <>
Submitted on : Thursday, June 13, 2019 - 4:57:21 PM
Last modification on : Wednesday, June 19, 2019 - 1:24:29 AM

File

CASA2019AuthorVersion.pdf
Files produced by the author(s)

Identifiers

Citation

Grégoire Dupont de Dinechin, Alexis Paljic. Virtual Agents from 360° Video for Interactive Virtual Reality. 32nd International Conference on Computer Animation and Social Agents (CASA 2019), Jul 2019, Paris, France. ⟨10.1145/3328756.3328775⟩. ⟨hal-02155594⟩

Share

Metrics

Record views

62

Files downloads

89