The ecological approach to multimodal system design

Abstract : Following the ecological approach to visual perception, this paper presents a framework that emphasizes the role of vision on referring actions. In particular, affordances are utilized to explain gestures variability in a multimodal human-computer interaction. Such a proposal is consistent with empirical findings obtained in different simulation studies showing how referring gestures are determined by the mutuality of information coming from the target and the set of movements available to the speaker. A prototype that follows anthropomorphic perceptual principles to analyze gestures has been developed and tested in preliminary computational validations.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [5 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00079132
Contributor : Laurent Romary <>
Submitted on : Friday, June 9, 2006 - 11:12:00 AM
Last modification on : Friday, March 22, 2019 - 2:22:12 PM
Document(s) archivé(s) le : Monday, April 5, 2010 - 10:34:50 PM

Files

Identifiers

  • HAL Id : hal-00079132, version 1

Collections

Citation

Antonella de Angeli, Frédéric Wolff, Laurent Romary, Walter Gerbino. The ecological approach to multimodal system design. 1999, pp.49-52. ⟨hal-00079132⟩

Share

Metrics

Record views

258

Files downloads

90