Ether-Toolbars: Evaluating Off-Screen Toolbars for Mobile Interaction

Hanaë Rateau 1, 2 Yosra Rekik 3 Edward Lank 4 Laurent Grisoni 3
1 MINT2 - Méthodes et outils pour l'Interaction à gestes
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
3 MINT - Methods and tools for gestural interactions
LIFL - Laboratoire d'Informatique Fondamentale de Lille, Inria Lille - Nord Europe, IRCICA
Abstract : In mobile touchscreebn interaction, an important challenge is to find solutions to balance the size of individual widgets against the number of widgets needed during interaction. In this work, to address display space limitations, we explore the design of invisible off-screen toolbars (ether-toolbars) that leverage computer vision to expand application features by placing widgets adjacent to the display screen. We show how simple computer vision algorithms can be combined with a natural human ability to estimate physical placing to support highly accurate targeting. Our ether-toolbar design promises targeting accuracy approximating on-screen widget accuracy while significantly expanding the interaction space of mobile devices. Through two experiments, we examine off-screen content placement metaphors and off-screen precision of participants accessing these toolbars. From the data of the second experiment, we provide a basic model that reflects how users perceive mobile surroundings for ether-widgets and validate it. We also demonstrate a prototype system consisting of an inexpensive 3D printed mount for a mirror that supports ether-toolbar implementations. Finally, we discuss the implications of our work and potential design extensions that can increase the usability and the utility of ether-toolbars.
Document type :
Conference papers
Complete list of metadatas

Cited literature [16 references]  Display  Hide  Download
Contributor : Hanaë Rateau <>
Submitted on : Friday, March 2, 2018 - 11:13:15 AM
Last modification on : Friday, March 22, 2019 - 1:36:26 AM
Long-term archiving on : Thursday, May 31, 2018 - 12:20:15 PM


Files produced by the author(s)



Hanaë Rateau, Yosra Rekik, Edward Lank, Laurent Grisoni. Ether-Toolbars: Evaluating Off-Screen Toolbars for Mobile Interaction. IUI 2018 - 23rd International Conference on Intelligent User Interfaces, Mar 2018, Tokyo, Japan. ⟨10.1145/3172944.3172978⟩. ⟨hal-01683967⟩



Record views


Files downloads