Multi-touch gesture interactions and deformable geometry for 3D edition on touch screen

Rémi Brouet 1, 2
1 IMAGINE - Intuitive Modeling and Animation for Interactive Graphics & Narrative Environments
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 LIG Laboratoire d'Informatique de Grenoble - IIHM
LIG - Laboratoire d'Informatique de Grenoble, Inria - Institut National de Recherche en Informatique et en Automatique
Abstract : Despite the advances made in the fields of existing objects capture and of procedural generation, creation of content for virtual worlds can not be perform without human interaction. This thesis suggests to exploit new touch devices ("multi-touch" screens) to obtain an easy, intuitive 2D interaction in order to navigate inside a virtual environment, to manipulate, position and deform 3D objects. First, we study the possibilities and limitations of the hand and finger gestures while interacting on a touch screen in order to discover which gestures are the most adapted to edit 3D scene and environment. In particular, we evaluate the effective number of degrees of freedom of the human hand when constrained on a planar surface. Meanwhile, we develop a new gesture analysis method using phases to identify key motion of the hand and fingers in real time. These results, combined to several specific user-studies, lead to a gestural design pattern which handle not only navigation (camera positioning), but also object positioning, rotation and global scaling. Then, this pattern is extended to complex deformation (such as adding and deleting material, bending or twisting part of objects, using local control). Using these results, we are able to propose and evaluate a 3D world editing interface that handle a natural touch interaction, in which mode selection (i.e. navigation, object positioning or object deformation) and task selections is automatically processed by the system, relying on the gesture and the interaction context (without any menu or button). Finally, we extend this interface to integrate more complex deformations, adapting the garment transfer from a character to any other in order to process interactive deformation of the garment while the wearing character is deformed.
Document type :
Theses
Complete list of metadatas

Cited literature [106 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/tel-01517102
Contributor : Imagine Team <>
Submitted on : Tuesday, May 2, 2017 - 4:26:11 PM
Last modification on : Thursday, October 11, 2018 - 8:48:03 AM
Long-term archiving on : Thursday, August 3, 2017 - 1:30:50 PM

Identifiers

  • HAL Id : tel-01517102, version 1

Citation

Rémi Brouet. Multi-touch gesture interactions and deformable geometry for 3D edition on touch screen. Graphics [cs.GR]. Université de Grenoble (France), 2015. English. ⟨tel-01517102⟩

Share

Metrics

Record views

248

Files downloads

311