Performance decline in low-stakes educational assessments: different mixture modeling approaches

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Marit K. List
  • Alexander Robitzsch
  • Oliver Lüdtke
  • Olaf Köller
  • Gabriel Nagy

Background: In low-stakes educational assessments, test takers might show a performance decline (PD) on end-of-test items. PD is a concern in educational assessments, especially when groups of students are to be compared on the proficiency variable because item responses gathered in the groups could be differently affected by PD. In order to account for PD, mixture item response theory (IRT) models have been proposed in the literature. Methods: In this article, multigroup extensions of three existing mixture models that assess PD are compared. The models were applied to the mathematics test in a large-scale study targeting school track differences in proficiency. Results: Despite the differences in the specification of PD, all three models showed rather similar item parameter estimates that were, however, different from the estimates given by a standard two parameter IRT model. In addition, all models indicated that the amount of PD differed between tracks, in that school track differences in proficiency were slightly reduced when PD was accounted for. Nevertheless, the models gave different estimates of the proportion of students showing PD, and differed somewhat from each other in the adjustment of proficiency scores for PD. Conclusions: Multigroup mixture models can be used to study how PD interacts with proficiency and other variables to provide a better understanding of the mechanisms behind PD. Differences between the presented models with regard to their assumptions about the relationship between PD and item responses are discussed.

Original languageEnglish
Article number15
JournalLarge-Scale Assessments in Education
Volume5
Issue number1
Number of pages25
ISSN2196-0739
DOIs
Publication statusPublished - 01.12.2017
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2017, The Author(s).

Recently viewed

Publications

  1. High temperature deformation of magnesium alloy TX32-0.4Al-0.8Si
  2. Cinephilia in transition
  3. Zootechnologien
  4. Tri‐trophic interaction networks along a tree diversity gradient of BEF‐China
  5. Cognitive load theory
  6. Predicting the interfacial heat transfer coefficient of cast Mg-Al alloys using Beck's inverse analysis
  7. Symmetry-aided computation of the detour matrix and the detour index
  8. Ergebnisse einer Sparkassen-Umfrage
  9. Secondary School Students’ Perceptions of Autonomy, Competence, and Relatedness in Digital Learning
  10. Artificial intelligence in sustainable development research
  11. Learning Soccer in Elementary School: Using Teaching Games for Understanding and Digital Media
  12. Piloting Citizen Science Methods to Measure Perceptions of Carbon Footprint and Energy Content of Food
  13. Ein gemeinsamer europäischer Referenzrahmen für Sprachen oder für Englisch?
  14. Reinventing the Politics of Knowledge Production in Migration Studies
  15. Policy schemes, operational strategies and system integration of residential co-generation fuel cells.
  16. Back for more
  17. Influence of Torsion on Precipitation and Hardening Effects during Aging of an Extruded AZ91 Alloy
  18. Hermann Bahr
  19. Ökofeminismus
  20. Temporary exports and characteristics of destination countries
  21. Karten und Pläne
  22. Integrating Ecosystem Services in Nature Conservation for Colombia
  23. Towards space traffic management
  24. Accounting for Eco-Efficiency
  25. Ecosystem services and sustainability: descriptive means, normative goals and societal transformations
  26. Werturteil II
  27. Self-Wiring Question Answering Systems