Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction

Mikkel Rønne Jakobsen (1) , Yvonne Jansen (1) , Sebastian Boring (1) , Kasper Hornbæk (1)

1 UCPH - University of Copenhagen = Københavns Universitet

Users can interact with large displays in many ways, including touch and mid-air gestures. However, it remains unclear how these ways compare and when users choose one over the other. In a first experiment, we compare touch and mid-air gestures to identify their relative performance for target acquisition. In a second experiment, participants choose freely between touch and mid-air gestures and we artificially require movement to simulate situations where mid-air is considered beneficial. Results from the first experiment show mid-air to be overall slower than touch depending on the task; in the second experiment, participants mostly chose touch in particular for selecting small targets and they rarely switched between mid-air and touch. Results also show that when faced with an increasing cost of using touch in the form of movement, participants chose mid-air over touch; touch remains as fast as mid-air on average.

Mots clés: Large display; Mid-air; Touch; Freehand gestures; User study

Domaines: Interface homme-machine [cs.HC]

Mikkel Rønne Jakobsen, Yvonne Jansen, Sebastian Boring, Kasper Hornbæk. Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction. 15th Human-Computer Interaction (INTERACT), Sep 2015, Bamberg, Germany. pp.455-473, ⟨10.1007/978-3-319-22698-9_31⟩. ⟨hal-01399088⟩