Simultaneous Constrained Adaptive Item Selection for Group-Based Testing

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

By tailoring test forms to the test-taker's proficiency, Computerized Adaptive Testing (CAT) enables substantial increases in testing efficiency over fixed forms testing. When used for formative assessment, the alignment of task difficulty with proficiency increases the chance that teachers can derive useful feedback from assessment data. The application of CAT to formative assessment in the classroom, however, is hindered by the large number of different items used for the whole class; the required familiarization with a large number of test items puts a significant burden on teachers. An improved CAT procedure for group-based testing is presented, which uses simultaneous automated test assembly to impose a limit on the number of items used per group. The proposed linear model for simultaneous adaptive item selection allows for full adaptivity and the accommodation of constraints on test content. The effectiveness of the group-based CAT is demonstrated with real-world items in a simulated adaptive test of 3,000 groups of test-takers, under different assumptions on group composition. Results show that the group-based CAT maintained the efficiency of CAT, while a reduction in the number of used items by one half to two-thirds was achieved, depending on the within-group variance of proficiencies.

Original languageEnglish
JournalJournal of Educational Measurement
Volume58
Issue number2
Pages (from-to)236-261
Number of pages26
ISSN0022-0655
DOIs
Publication statusPublished - 01.06.2021

DOI

Recently viewed

Publications

  1. Different complex word problems require different combinations of cognitive skills
  2. Kinematic self-calibration of non-contact five-axis measuring machine using improved genetic algorithm.
  3. Age effects on controlling tools with sensorimotor transformations
  4. Appendix A: Design, implementation, and analysis of the iGOES project
  5. A PHENOMENOGRAPHICAL STUDY OF CHILDRENS’ SPATIAL THOUGHT WHILE USING MAPS IN REAL SPACES
  6. A Lean Convolutional Neural Network for Vehicle Classification
  7. An extended analytical approach to evaluating monotonic functions of fuzzy numbers
  8. Effects of diversity versus segregation on automatic approach and avoidance behavior towards own and other ethnic groups
  9. Developing a Complex Portrait of Content Teaching for Multilingual Learners via Nonlinear Theoretical Understandings
  10. Support vector machines with example dependent costs
  11. The structure of emotions in learning situations
  12. Reciprocal Relationships Between Dispositional Optimism and Work Experiences
  13. Conceptualizing Role Development in Agile Transformations
  14. Predicate‐based model of problem‐solving for robotic actions planning
  15. Vergütung, variable
  16. Sensitivity to complexity - an important prerequisite of problem solving mathematics teaching
  17. Study of fuzzy controllers performance
  18. Performance Saga: Interview 01
  19. Employing A-B tests for optimizing prices levels in e-commerce applications
  20. An analytical approach to evaluating nonmonotonic functions of fuzzy numbers
  21. Between Recognition and Abstraction
  22. Species constancy depends on plot size - A problem for vegetation classification and how it can be solved
  23. The Relation of Children's Performances in Spatial Tasks at Two Different Scales of Space
  24. Petri net based EMIS-mappers for flexible manufacturing systems
  25. Schooling, local knowledge and working memory
  26. Practice and carryover effects when using small interaction devices
  27. Scaling-based Least Squares Methods with Implemented Kalman filter Approach for Nano-Parameters Identification
  28. Fusion of knowledge bases for better navigation of wheeled mobile robotic group with 3D TVS
  29. Learning linear classifiers sensitive to example dependent and noisy costs
  30. Model and Validation of the Electromagnetic Interference Produced by Power Transmission Lines in Robotic Systems
  31. Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities