Efficient Scoring of Multiple-Choice Tests

Abstract : This paper studies the optimal scoring of multiple choice tests by using standard estimation theory where obtained scores are efficient estimators of examinees' ability. The marks for wrong selections and omissions jointly minimize the mean square difference between obtained score and ability. Examinees are loss averse, ie. disproportionately weight the penalty for wrong selection in their utility function, which entails a preference for omission. With a limited number of items, it is efficient to incentivize the lowest able to omit as their answers essentially reflect noise. The shorter the test, the stronger the incentives to omit. Loss aversion improves estimators efficiency by inducing more omission, which reduces the need to bias the marks to foster omission. The model also sheds new lights on the statistical properties of two widely used scoring methods: number right and formula scoring. J.E.L. codes: A200, C930, D800
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

Cited literature [39 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02262181
Contributor : Alexis Direr <>
Submitted on : Friday, August 2, 2019 - 9:24:15 AM
Last modification on : Saturday, August 3, 2019 - 1:41:55 AM

File

qcm_v10.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02262181, version 1

Collections

Citation

Alexis Direr. Efficient Scoring of Multiple-Choice Tests. 2019. ⟨hal-02262181⟩

Share

Metrics

Record views

27

Files downloads

25