A generic framework for executable gestural interaction models

Abstract : Integrating new input devices and their associated interaction techniques into interactive applications has always been challenging and time-consuming, due to the learning curve and technical complexity involved. Modeling devices, interactions and applications helps reducing the accidental complexity. Visual modeling languages can hide an important part of the technical aspects involved in the development process, thus allowing a faster and less error-prone development process. However, even with the help of modeling, a gap remains to be bridged in order to go from models to the actual implementation of the interactive application. In this paper we use ICO, a visual formalism based on high-level Petri nets, to develop a generic layered framework for specifying executable models of interaction using gestural input devices. By way of the CASE tool Petshop we demonstrate the framework's feasibility to handle the Kinect and gesture-based interaction techniques. We validate the approach through two case studies that illustrate how to use executable, reusable and extensible ICO models to develop gesture-based applications.
Complete list of metadatas

Cited literature [9 references]  Display  Hide  Download

Contributor : Open Archive Toulouse Archive Ouverte (oatao) <>
Submitted on : Monday, July 20, 2015 - 1:53:54 PM
Last modification on : Thursday, June 27, 2019 - 4:27:42 PM
Long-term archiving on : Wednesday, October 21, 2015 - 10:51:13 AM


Files produced by the author(s)


  • HAL Id : hal-01178580, version 1
  • OATAO : 13006



Romuald Deshayes, Tom Mens, Philippe Palanque. A generic framework for executable gestural interaction models. IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2013), Sep 2013, San Jose, CA, United States. pp. 35-38. ⟨hal-01178580⟩



Record views


Files downloads