Performance decline in low-stakes educational assessments: different mixture modeling approaches

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Marit K. List
  • Alexander Robitzsch
  • Oliver Lüdtke
  • Olaf Köller
  • Gabriel Nagy

Background: In low-stakes educational assessments, test takers might show a performance decline (PD) on end-of-test items. PD is a concern in educational assessments, especially when groups of students are to be compared on the proficiency variable because item responses gathered in the groups could be differently affected by PD. In order to account for PD, mixture item response theory (IRT) models have been proposed in the literature. Methods: In this article, multigroup extensions of three existing mixture models that assess PD are compared. The models were applied to the mathematics test in a large-scale study targeting school track differences in proficiency. Results: Despite the differences in the specification of PD, all three models showed rather similar item parameter estimates that were, however, different from the estimates given by a standard two parameter IRT model. In addition, all models indicated that the amount of PD differed between tracks, in that school track differences in proficiency were slightly reduced when PD was accounted for. Nevertheless, the models gave different estimates of the proportion of students showing PD, and differed somewhat from each other in the adjustment of proficiency scores for PD. Conclusions: Multigroup mixture models can be used to study how PD interacts with proficiency and other variables to provide a better understanding of the mechanisms behind PD. Differences between the presented models with regard to their assumptions about the relationship between PD and item responses are discussed.

Original languageEnglish
Article number15
JournalLarge-Scale Assessments in Education
Volume5
Issue number1
Number of pages25
ISSN2196-0739
DOIs
Publication statusPublished - 01.12.2017
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2017, The Author(s).

Recently viewed

Publications

  1. Beyond pandemic populism
  2. What does theology do, actually?
  3. Ballons
  4. Scotland
  5. Modelling the effect of belowground herbivory on grassland diversity
  6. Erdgeschichte schreiben
  7. Idioms
  8. Science, policy and implementation gaps: An exploration of groundwater management in Hungary
  9. Wir müssen reden!
  10. Selbstständiges Lernen in einer Lernwerkstatt
  11. Consistency and Credibility?
  12. Entrepreneurial orientation and business performance
  13. MIKAS - Mikroanalysen und amtliche Statistik
  14. “IT’s the Devil”
  15. Einleitung
  16. "A letter as by Us"
  17. "Konfrontative Pädagogik"
  18. Wuthering heights
  19. Beschämende Niederlagen
  20. Positive interactions between nitrogen-fixing legumes and four different neighbouring species in a biodiversity experiment
  21. Debating accounting and sustainability: from incompatibility to rapprochement in the pursuit of corporate sustainability
  22. Nonadherence in outpatient thrombosis prophylaxis with low molecular weight heparins after major orthopaedic surgery
  23. Introduction
  24. Die mythologische Differenz
  25. Vergütung, variable
  26. The Theatricality of Organizational Atmosphere
  27. Ressourcen- oder mitgliederbasiert?
  28. Bird Diversity and the Resilience of Southwestern Ethiopian Forests
  29. Lob des Berührens
  30. Yellow submarine
  31. Institutional entrepreneurship for responsible digital innovation
  32. Cybermobbing, Hatespeech, Sexting und Cybergrooming.
  33. Philosophy of Religion
  34. Power from the Desert
  35. Regulation of Access to Limited Resources in the Telecommunications Sector in Europe
  36. Effects of phosphorous, nitrogen, and carbon limitation on biomass composition in batch and continuous flow cultures of the heterotrophic dinoflagellate Crypthecodinium cohnii
  37. Crack propagation under bending in cast MglOGdxNd-T4 alloys