Assessing Learning with MetaTutor, a Multi-Agent Hypermedia Learning Environment

Abstract : In this paper we discuss the ways in which assessments of learning were evaluated, designed, and implemented in {MetaTutor} (a multi-agent, hypermedia learning environment about several human body systems; Azevedo et al., 2012, 2013). We also share the lessons that we have learned from assessing learning with {MetaTutor} across three different universities and three studies (N = 336). Techniques and considerations for assessing learning are shared, including pedagogical and psychometric properties of items. Results revealed significant differences in pre to posttest learning across all studies and that changes to the content and assessments of learning lead to lower scores, in particular, on the pretest where cores had previously been high and limited variance. The methods and results of this paper can be used to motivate other researchers who use {CBLEs} to examine and improve the psychometric and pedagogical features of their learning assessments.
Document type :
Conference papers
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01217167
Contributor : Lip6 Publications <>
Submitted on : Monday, October 19, 2015 - 10:45:06 AM
Last modification on : Tuesday, March 26, 2019 - 5:49:52 PM

Identifiers

  • HAL Id : hal-01217167, version 1

Citation

Jason M. Harley, François Bouchet, Niki Papaioannou, Cassia Carter, Gregory J. Trevors, et al.. Assessing Learning with MetaTutor, a Multi-Agent Hypermedia Learning Environment. The 2014 Annual meeting of the American Educational Research Association, Apr 2014, Philadelphia, PA, United States. ⟨hal-01217167⟩

Share

Metrics

Record views

115