A Framework for a Multimodal Analysis of Teaching Centered on Shared Attention and Knowledge Access

Philippe Dessus 1, 2 Louise-Héléna Aubineau 2 Dominique Vaufreydaz 1 James L. Crowley 1
1 PERVASIVE - Interaction située avec les objets et environnements intelligents
Inria Grenoble - Rhône-Alpes, Université de Grenoble-Alpes, LIG - Laboratoire d'Informatique de Grenoble, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
Abstract : The effects of teaching on learning are mostly uncertain, hidden, and not immediate. Research investigating how teaching can have an impact on learning has recently been given a significant boost with signal processing devices and data mining analyses. We devised a framework for the study of teaching and learning processes which posits that lessons are composed of episodes of joint attention and access to the taught content, and that the interplay of behaviors like joint attention, actional contingency, and feedback loops compose different levels of teaching. Teaching by social tolerance, which occurs when learners (Ls) have no attentional problems but their access to the taught knowledge depends on the teacher (T). Teaching by opportunity provisioning, when Ls can be aware on the taught content but lack access to it (e.g., lack of understanding), and T builds ad hoc situations in which Ls are provided with easier content. Teaching by stimulus or local enhancement, when Ls have fully access to the content but lack attention toward it. T explicitly shows content to Ls, slows down her behaviors, tells and acts in an adapted way (e.g., motherese). A variety of devices installed in a classroom will capture and automatically characterize these events. T’s and Ls’ utterances and gazes will be recorded through low-cost cameras installed on 3D printed glasses, and T will wear a mobile eye tracker and a mobile microphone. Instructional material is equipped with qrcodes so that Ls’ and T’s video streams are processed to determine where people are looking at, and to infer the corresponding teaching levels. This novel framework will be used to analyze instructional events in ecological situations, and will be a first step to build a ”pervasive classroom”, where eye-tracking and sensor-based devices analyze a wide range of events in a multimodal and interdisciplinary way.
Type de document :
Communication dans un congrès
Grenoble Workshop on Models and Analysis of Eye Movements, Jun 2018, Grenoble, France. 2018, 〈https://eyemovements.sciencesconf.org〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01811092
Contributeur : Philippe Dessus <>
Soumis le : vendredi 22 juin 2018 - 11:09:50
Dernière modification le : mercredi 31 octobre 2018 - 01:16:07
Document(s) archivé(s) le : mardi 25 septembre 2018 - 21:11:25

Fichier

eye-mov-18.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01811092, version 1

Collections

Citation

Philippe Dessus, Louise-Héléna Aubineau, Dominique Vaufreydaz, James L. Crowley. A Framework for a Multimodal Analysis of Teaching Centered on Shared Attention and Knowledge Access. Grenoble Workshop on Models and Analysis of Eye Movements, Jun 2018, Grenoble, France. 2018, 〈https://eyemovements.sciencesconf.org〉. 〈hal-01811092〉

Partager

Métriques

Consultations de la notice

181

Téléchargements de fichiers

40