Evaluation of Learner Performance during Practical Activities: an Experimentation in Computer Education

Rémi Venant (1) , Philippe Vidal (1) , Julien Broisin (1, 2)

1 IRIT-SIERA - Service IntEgration and netwoRk Administration
2 UT3 - Université Toulouse III - Paul Sabatier

This paper addresses learning analytics for evaluation of learners performance in remote laboratories. The objectives we identified to provide self-and social awareness while learners are practicing in their virtual learning environment are threefold: (1) the definition of a performance metric that requires no assessment tests, (2) the tracking of data to infer that metric in real time, and (3) the visualization of the performance metric without impacting learners' cognitive load. To support these needs, we propose (i) a metric related to the technical rightness of instructions carried out by learners, (ii) a generic learning analytics framework featuring an enriching engine able to infer indicators, and (iii) two distinct visualization tools. These proposals have been implemented in Lab4CE, our remote laboratory for computer education, and experimented in an authentic learning context. This experimentation showed that most students have significantly used both visualization tools, and that their usage decreased while the overall learners performance increased.

Mots clés: Remote laboratory; Awareness tools; Learning analytics; Learner performance; Computer education

Domaines: Réseaux et télécommunications [cs.NI]; Système d'exploitation [cs.OS]; Architectures Matérielles [cs.AR]; Systèmes embarqués

Rémi Venant, Philippe Vidal, Julien Broisin. Evaluation of Learner Performance during Practical Activities: an Experimentation in Computer Education. 16th IEEE International Conference on Advanced Learning Technologies (ICALT 2016), Jul 2016, Austin, Texas, United States. pp. 237-241. ⟨hal-01436164⟩