Skip to Main content Skip to Navigation
Journal articles

Same Test, Better Scores: Boosting the Reliability of Short Online Intelligence Recruitment Tests with Nested Logit Item Response Theory Models

Abstract : Assessing job applicants’ general mental ability online poses psychometric challenges due to the necessity of having brief but accurate tests. Recent research (Myszkowski & Storme, 2018) suggests that recovering distractor information through Nested Logit Models (NLM; Suh & Bolt, 2010) increases the reliability of ability estimates in reasoning matrix-type tests. In the present research, we extended this result to a different context (online intelligence testing for recruitment) and in a larger sample ( N=2949 job applicants). We found that the NLMs outperformed the Nominal Response Model (Bock, 1970) and provided significant reliability gains compared with their binary logistic counterparts. In line with previous research, the gain in reliability was especially obtained at low ability levels. Implications and practical recommendations are discussed.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03001692
Contributor : Isabelle Celet Connect in order to contact the contributor
Submitted on : Thursday, November 12, 2020 - 2:37:25 PM
Last modification on : Wednesday, November 3, 2021 - 6:49:50 AM

Links full text

Identifiers

Collections

Citation

Martin Storme, Nils Myszkowski, Simon Baron, David Bernard. Same Test, Better Scores: Boosting the Reliability of Short Online Intelligence Recruitment Tests with Nested Logit Item Response Theory Models. Journal of Intelligence, MDPI, 2019, 7 (3), pp.17. ⟨10.3390/jintelligence7030017⟩. ⟨hal-03001692⟩

Share

Metrics

Record views

38