Simultaneous Constrained Adaptive Item Selection for Group-Based Testing

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

By tailoring test forms to the test-taker's proficiency, Computerized Adaptive Testing (CAT) enables substantial increases in testing efficiency over fixed forms testing. When used for formative assessment, the alignment of task difficulty with proficiency increases the chance that teachers can derive useful feedback from assessment data. The application of CAT to formative assessment in the classroom, however, is hindered by the large number of different items used for the whole class; the required familiarization with a large number of test items puts a significant burden on teachers. An improved CAT procedure for group-based testing is presented, which uses simultaneous automated test assembly to impose a limit on the number of items used per group. The proposed linear model for simultaneous adaptive item selection allows for full adaptivity and the accommodation of constraints on test content. The effectiveness of the group-based CAT is demonstrated with real-world items in a simulated adaptive test of 3,000 groups of test-takers, under different assumptions on group composition. Results show that the group-based CAT maintained the efficiency of CAT, while a reduction in the number of used items by one half to two-thirds was achieved, depending on the within-group variance of proficiencies.

Original languageEnglish
JournalJournal of Educational Measurement
Volume58
Issue number2
Pages (from-to)236-261
Number of pages26
ISSN0022-0655
DOIs
Publication statusPublished - 01.06.2021

DOI

Recently viewed

Publications

  1. Noise Detection for Biosignals Using an Orthogonal Wavelet Packet Tree Denoising Algorithm
  2. An on-line orthogonal wavelet denoising algorithm for high-resolution surface scans
  3. Age-related differences in processing visual device and task characteristics when using technical devices
  4. Modeling and simulation of inelastic microstructure development and inhomogeneous material behavior via non-convex rate dependent gradient plasticity
  5. Dynamic adjustment of dispatching rule parameters in flow shops with sequence-dependent set-up times
  6. Using complexity metrics with R-R intervals and BPM heart rate measures
  7. Towards a Dynamic Interpretation of Subjective and Objective Values
  8. An Improved Approach to the Semi-Process-Oriented Implementation of Standardised ERP-Systems
  9. Comparing the Sensitivity of Social Networks, Web Graphs, and Random Graphs with Respect to Vertex Removal
  10. Different complex word problems require different combinations of cognitive skills
  11. Linux-based Embedded System for Wavelet Denoising and Monitoring of sEMG Signals using an Axiomatic Seminorm
  12. Kinematic self-calibration of non-contact five-axis measuring machine using improved genetic algorithm.
  13. The Use of Genetic Algorithm for PID Controller Auto-Tuning in ARM CORTEX M4 Platform
  14. A lyapunov approach in the derivative approximation using a dynamic system
  15. Age effects on controlling tools with sensorimotor transformations
  16. Switching from a Managing to a Monitoring Function on the Board
  17. Appendix A: Design, implementation, and analysis of the iGOES project
  18. Analyzing User Journey Data In Digital Health: Predicting Dropout From A Digital CBT-I Intervention
  19. Changes in the Complexity of Limb Movements during the First Year of Life across Different Tasks
  20. Structure and dynamics laboratory testing of an indirectly controlled full variable valve train for camless engines
  21. The Use of Factorization and Multimode Parametric Spectra in Estimating Frequency and Spectral Parameters of Signal
  22. Guest Editorial Special Issue on Sensors in Machine Vision of Automated Systems
  23. Exploiting linear partial information for optimal use of forecasts. With an application to U.S. economic policy
  24. Agency and structure in a sociotechnical transition
  25. Control of an Electromagnetic Linear Actuator Using Flatness Property and Systems Inversion
  26. A PHENOMENOGRAPHICAL STUDY OF CHILDRENS’ SPATIAL THOUGHT WHILE USING MAPS IN REAL SPACES
  27. A Lean Convolutional Neural Network for Vehicle Classification
  28. Robust Flatness Based Control of an Electromagnetic Linear Actuator Using Adaptive PID Controller
  29. An extended analytical approach to evaluating monotonic functions of fuzzy numbers
  30. Understanding the properties of isospectral points and pairs in graphs
  31. Considerations on efficient touch interfaces - How display size influences the performance in an applied pointing task
  32. Performance analysis for loss systems with many subscribers and concurrent services