Performance decline in low-stakes educational assessments: different mixture modeling approaches

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

  • Marit K. List
  • Alexander Robitzsch
  • Oliver Lüdtke
  • Olaf Köller
  • Gabriel Nagy

Background: In low-stakes educational assessments, test takers might show a performance decline (PD) on end-of-test items. PD is a concern in educational assessments, especially when groups of students are to be compared on the proficiency variable because item responses gathered in the groups could be differently affected by PD. In order to account for PD, mixture item response theory (IRT) models have been proposed in the literature. Methods: In this article, multigroup extensions of three existing mixture models that assess PD are compared. The models were applied to the mathematics test in a large-scale study targeting school track differences in proficiency. Results: Despite the differences in the specification of PD, all three models showed rather similar item parameter estimates that were, however, different from the estimates given by a standard two parameter IRT model. In addition, all models indicated that the amount of PD differed between tracks, in that school track differences in proficiency were slightly reduced when PD was accounted for. Nevertheless, the models gave different estimates of the proportion of students showing PD, and differed somewhat from each other in the adjustment of proficiency scores for PD. Conclusions: Multigroup mixture models can be used to study how PD interacts with proficiency and other variables to provide a better understanding of the mechanisms behind PD. Differences between the presented models with regard to their assumptions about the relationship between PD and item responses are discussed.

OriginalspracheEnglisch
Aufsatznummer15
ZeitschriftLarge-Scale Assessments in Education
Jahrgang5
Ausgabenummer1
Anzahl der Seiten25
ISSN2196-0739
DOIs
PublikationsstatusErschienen - 01.12.2017
Extern publiziertJa

Bibliographische Notiz

Publisher Copyright:
© 2017, The Author(s).

DOI

Zuletzt angesehen

Forschende

  1. Beatrice John