How Memorizing Positions or Directions Affects Gesture Learning?

Bruno Fruchard (1, 2) , Eric Lecolinet (1) , Olivier Chapuis (2, 3)

1 LTCI - Laboratoire Traitement et Communication de l'Information
2 LRI - Laboratoire de Recherche en Informatique
3 ILDA - Interacting with Large Data

Various techniques have been proposed to faster command selection. Many of them either rely on directional gestures (e.g. Marking menus) or pointing gestures using a spatially-stable arrangement of items (e.g. FastTap). Both types of techniques are known to leverage memorization, but not necessarily for the same reasons. In this paper, we investigate whether using directions or positions affects gesture learning. Our study shows that, while recall rates are not significantly different, participants used the novice mode more often and spent more time while learning commands with directional gestures, and they also reported more physical and mental efforts. Moreover, this study also highlights the importance of semantic relationships between gestural commands and reports on the memorization strategies that were elaborated by the participants.

Keywords: Memorization; spatial memory; pointing; gestures; command selection; user study

Domains: Human-Computer Interaction [cs.HC]

Bruno Fruchard, Eric Lecolinet, Olivier Chapuis. How Memorizing Positions or Directions Affects Gesture Learning?. Proceedings of the 2018 International Conference on Interactive Surfaces and Spaces, Nov 2018, Tokyo, Japan. pp.107--114, ⟨10.1145/3279778.3279787⟩. ⟨hal-01891436v2⟩