How to get really smart: Modeling retest and training effects in ability testing using computer-generated figural matrix items

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

The interpretation of retest scores is problematic because they are potentially affected by measurement and predictive bias, which impact construct validity, and because their size differs as a function of various factors. This paper investigates the construct stability of scores on a figural matrices test and models retest effects at the level of the individual test taker as a function of covariates (simple retest vs. training, use of identical vs. parallel retest forms, and general mental ability). A total of N=189 subjects took two tests of matrix items that were automatically generated according to a strict construction rationale. Between test administrations, participants in the intervention groups received training, while controls did not. The Rasch model fit the data at both time points, but there was a lack of item difficulty parameter invariance across time. Training increased test performance beyond simple retesting, but there was no large difference between the identical and parallel retest forms at the individual level. Individuals varied greatly in how they profited from retest experience, training, and the use of identical vs. parallel retest forms. The results suggest that even with carefully designed tasks, it is problematic to directly compare scores from initial tests and retests. Test administrators should emphasize learning potential instead of state level assessment, and inter-individual differences with regard to test experience should be taken into account when interpreting test results.
OriginalspracheEnglisch
ZeitschriftIntelligence
Jahrgang39
Ausgabenummer4
Seiten (von - bis)233-243
Anzahl der Seiten11
ISSN0160-2896
DOIs
PublikationsstatusErschienen - 07.2011

DOI

Zuletzt angesehen

Publikationen

  1. Control of a Sun Tracking Robot Based on Adaptive Sliding Mode Control with Kalman Filtering and Model Predictive Control
  2. Development of a quality assurance framework for the open source development model
  3. A coding scheme to analyse global text processing in computer supported collaborative learning: What eye movements can tell us
  4. Knowledge Graph Question Answering Using Graph-Pattern Isomorphism
  5. Contributions of declarative and procedural memory to accuracy and automatization during second language practice
  6. Expertise in research integration and implementation for tackling complex problems
  7. Isocodal and isospectral points, edges, and pairs in graphs and how to cope with them in computerized symmetry recognition
  8. A discrete approximate solution for the asymptotic tracking problem in affine nonlinear systems
  9. Semi-supervised learning for structured output variables
  10. Ambient Intelligence and Knowledge Processing in Distributed Autonomous AAL-Components
  11. Anatomy of Haar Wavelet Filter and Its Implementation for Signal Processing
  12. Enhancing Performance of Level System Modeling with Pseudo-Random Signals
  13. Neural Combinatorial Optimization on Heterogeneous Graphs
  14. On robustness properties in permanent magnet machine control by using decoupling controller
  15. Kinematic self-calibration of non-contact five-axis measuring machine using improved genetic algorithm.
  16. A transfer operator based computational study of mixing processes in open flow systems
  17. Integrating errors into the training process
  18. Patching Together a Global Script
  19. Distinguishing state variability from trait change in longitudinal data
  20. An Improved Approach to the Semi-Process-Oriented Implementation of Standardised ERP-Systems
  21. Gaussian processes for dispatching rule selection in production scheduling
  22. Evaluation of Time/Phase Parameters in Frequency Measurements for Inertial Navigation Systems
  23. Machine Learning and Knowledge Discovery in Databases
  24. Clustering Hydrological Homogeneous Regions and Neural Network Based Index Flood Estimation for Ungauged Catchments
  25. Gain Scheduling Controller for Improving Level Control Performance
  26. The role of reading time complexity and reading speed in text comprehension
  27. A denoising procedure using wavelet packets for instantaneous detection of pantograph oscillations
  28. Don’t underestimate the problems of user centredness in software development projectsthere are many!?
  29. Control condition design and implementation features in controlled trials
  30. Latent structure perceptron with feature induction for unrestricted coreference resolution
  31. Using cross-recurrence quantification analysis to compute similarity measures for time series of unequal length with applications to sleep stage analysis
  32. Understanding the socio-technical aspects of low-code adoption for software development
  33. Beyond Path Dependency
  34. Database on Learning for Sustainable Development – analysis of projects