Ecological Interfaces: Extending the Pointing Paradigm by Visual Context

Antonella de Angeli (1) , Laurent Romary (2) , Frédéric Wolff (2)

1 CTL - Cognitive Technology Laboratory, Department of Psychology
2 LANGUE ET DIALOGUE - Human-machine dialogue with a significant language component

Following the ecological approach to visual perception, this paper presents an innovative framework for the design of multimodal systems. The proposal emphasises the role of the visual context on gestural communication. It is aimed at extending the concept of affordances to explain referring gesture variability. The validity of the approach is confirmed by results of a simulation experiment. A discussion of practical implications of our findings for software architecture design is presented.

Domaines: Informatique et langage [cs.CL]

Antonella de Angeli, Laurent Romary, Frédéric Wolff. Ecological Interfaces: Extending the Pointing Paradigm by Visual Context. CONTEXT 1999: Modeling and Using Context, Sep 1999, Trento, Italy. pp.91-104, ⟨10.1007/3-540-48315-2_8⟩. ⟨hal-00079181⟩