A Semiparametric Approach for Modeling Not-Reached Items

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Marit Kristine List
  • Olaf Köller
  • Gabriel Nagy

Tests administered in studies of student achievement often have a certain amount of not-reached items (NRIs). The propensity for NRIs may depend on the proficiency measured by the test and on additional covariates. This article proposes a semiparametric model to study such relationships. Our model extends Glas and Pimentel’s item response theory model for NRIs by (1) including a semiparametric representation of the distribution of the onset of NRIs, (2) modeling the relationships of NRIs with proficiency via a flexible multinomial logit regression, and (3) including additional covariates to predict NRIs. We show that Glas and Pimentel’s and our model have close connections to event history analysis, thereby making it possible to apply tools developed in this context to the analysis of NRIs. Our model was applied to a timed low-stakes test of mathematics achievement. Our model fitted the data better than Glas and Pimentel’s model, and allowed for a more fine-grained assessment of the onset of NRIs. The results of a simulation study showed that our model accurately recovered the relationships of proficiency and covariates with the onset of NRIs, and reduced bias in the estimates of item parameters, proficiency distributions, and covariate effects on proficiency.

Original languageEnglish
JournalEducational and Psychological Measurement
Volume79
Issue number1
Pages (from-to)170-199
Number of pages30
ISSN0013-1644
DOIs
Publication statusPublished - 01.02.2019
Externally publishedYes

Bibliographical note

Publisher Copyright:
© The Author(s) 2017.

DOI

Recently viewed

Publications

  1. How Did It Get So Late So Soon? The Effects of Time Management Knowledge and Practice on Students’ Time Management Skills and Academic Performance
  2. Impact factors and regulatory mechanisms for material flow management
  3. The feasibility of using Apple's ResearchKit for recruitment and data collection
  4. Mechanical characterisation and modelling of electrospun materials for biomedical applications
  5. Integrating multiple elements of environmental justice into urban blue space planning using public participation geographic information systems
  6. Contracting for Space
  7. Combined MRI-PET dissects dynamic changes in plant structures and functions
  8. Multiscale solutions of the electromagnetic continuity differential equation using packets of harmonic wavelets
  9. Theme zones in English media discourse
  10. Model-based wind turbine control design with power tracking capability
  11. Operationalizing ecosystem services for the mitigation of soil threats
  12. Analysis of the construction of an autonomous robot to improve its energy efficiency when traveling through irregular terrain
  13. Tree diversity promotes functional dissimilarity and maintains functional richness despite species loss in predator assemblages
  14. Endemic predators, invasive prey and native diversity
  15. Petri net based EMIS-mappers for flexible manufacturing systems
  16. Automated scoring in the era of artificial intelligence
  17. The complementary relationship of exploration and exploitation in professional service firms: An exploratory study of IT consulting firms
  18. ETL ensembles for chunking, NER and SRL
  19. Structure as Infrastructure: The Interrelation of Fiber and Construction
  20. The Radius of Trust Problem Remains Resolved
  21. Fruit Detection and Yield Mass Estimation from a UAV Based RGB Dense Cloud for an Apple Orchard
  22. Exploring Leverages and Pitfalls of Context Collapse in Modern Communication
  23. Landscape models for use in studies of landscape change and habitat fragmentation
  24. Manual for Analysis of Soils and Related Materials