Understanding perceptual-gestural knowledge in TEL systems with eye-tracking

Abstract : This paper presents our methodology to capture and model multimodal interactions in Intelligent Tutoring Systems (ITS). We are specifically interested in perceptual-gestural interactions combining perceptions, gestures and other type of actions.Traces of such interactions are multisource and heterogeneous. The challenge is to foster their representation into sequences that render their multimodal nature. In this work, we want to show how the proposed representation yields the analysis of the influence of visual perceptions on learners’ performance. Our case study is the ITS TELEOS, a simulation based Intelligent Tutoring System dedicated to percutaneous orthopedic surgery. We also conducted an experiment on PILOTE 2, a flight simulation environment, to give a proof of concept of the genericity of our propositions.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01372937
Contributor : Vanda Luengo <>
Submitted on : Tuesday, September 27, 2016 - 8:37:01 PM
Last modification on : Monday, July 8, 2019 - 3:11:32 PM

Identifiers

  • HAL Id : hal-01372937, version 1

Citation

Ben-Manson Toussaint, Vanda Luengo, Francis Jambon. Understanding perceptual-gestural knowledge in TEL systems with eye-tracking. Revista Română de Interacţiune Om-Calculator, Editura MATRIX ROM, 2015, 8 (4), pp.321-340. ⟨http://rochi.utcluj.ro/rrioc/en/rrioc-2016-2.html⟩. ⟨hal-01372937⟩

Share

Metrics

Record views

218