User-Defined Gestural Interaction: a Study on Gesture Memorization

Jean-François Jégo (1) , Alexis Paljic (1) , Philippe Fuchs (2)

1 CAOR - Centre de Robotique
2 équipe RV&RA

In this paper we study the memorization of user created gestures for 3DUI. Wide public applications mostly use standardized gestures for interactions with simple contents. This work is motivated by two application cases for which a standardized approach is not possible and thus user specific or dedicated interfaces are needed. The first one is applications for people with limited sensory-motor abilities for whom generic interaction methods may not be adapted. The second one is creative arts applications, for which gesture freedom is part of the creative process. In this work, users are asked to create gestures for a set of tasks, in a specific phase, prior to using the system. We propose a user study to explore the question of gesture memorization. Gestures are recorded and recognized with a Hidden Markov Model. Results show that it seems difficult to recall more than two abstract gestures. Affordances strongly improve memorization whereas the use of colocalization has no significant effect.

Mots clés: User studies; 3D interaction; gesture; usability

Domaines: Interface homme-machine [cs.HC]

Jean-François Jégo, Alexis Paljic, Philippe Fuchs. User-Defined Gestural Interaction: a Study on Gesture Memorization. IEEE 3D User Interfaces, 3DUI 2013, Mar 2013, Orlando, Fl., United States. pp.N/A. ⟨hal-00786384⟩