How to get really smart: Modeling retest and training effects in ability testing using computer-generated figural matrix items

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

The interpretation of retest scores is problematic because they are potentially affected by measurement and predictive bias, which impact construct validity, and because their size differs as a function of various factors. This paper investigates the construct stability of scores on a figural matrices test and models retest effects at the level of the individual test taker as a function of covariates (simple retest vs. training, use of identical vs. parallel retest forms, and general mental ability). A total of N=189 subjects took two tests of matrix items that were automatically generated according to a strict construction rationale. Between test administrations, participants in the intervention groups received training, while controls did not. The Rasch model fit the data at both time points, but there was a lack of item difficulty parameter invariance across time. Training increased test performance beyond simple retesting, but there was no large difference between the identical and parallel retest forms at the individual level. Individuals varied greatly in how they profited from retest experience, training, and the use of identical vs. parallel retest forms. The results suggest that even with carefully designed tasks, it is problematic to directly compare scores from initial tests and retests. Test administrators should emphasize learning potential instead of state level assessment, and inter-individual differences with regard to test experience should be taken into account when interpreting test results.
OriginalspracheEnglisch
ZeitschriftIntelligence
Jahrgang39
Ausgabenummer4
Seiten (von - bis)233-243
Anzahl der Seiten11
ISSN0160-2896
DOIs
PublikationsstatusErschienen - 07.2011

DOI

Zuletzt angesehen

Publikationen

  1. A coding scheme to analyse global text processing in computer supported collaborative learning: What eye movements can tell us
  2. Control of a Sun Tracking Robot Based on Adaptive Sliding Mode Control with Kalman Filtering and Model Predictive Control
  3. Neural Network-Based Finite-Time Control for Stochastic Nonlinear Systems with Input Dead-Zone and Saturation
  4. Development of a quality assurance framework for the open source development model
  5. Spatial mislocalization as a consequence of sequential coding of stimuli
  6. Anatomy of Haar Wavelet Filter and Its Implementation for Signal Processing
  7. Contributions of declarative and procedural memory to accuracy and automatization during second language practice
  8. Discourse Analyses in Chat-based CSCL with Learning Protocols
  9. Expertise in research integration and implementation for tackling complex problems
  10. Isocodal and isospectral points, edges, and pairs in graphs and how to cope with them in computerized symmetry recognition
  11. A discrete approximate solution for the asymptotic tracking problem in affine nonlinear systems
  12. Semi-supervised learning for structured output variables
  13. Ambient Intelligence and Knowledge Processing in Distributed Autonomous AAL-Components
  14. Framework for setting up and operating biobanks
  15. Trajectory-based computational study of coherent behavior in flows
  16. Enhancing Performance of Level System Modeling with Pseudo-Random Signals
  17. Neural Combinatorial Optimization on Heterogeneous Graphs
  18. On robustness properties in permanent magnet machine control by using decoupling controller
  19. Kinematic self-calibration of non-contact five-axis measuring machine using improved genetic algorithm.
  20. A transfer operator based computational study of mixing processes in open flow systems
  21. Patching Together a Global Script
  22. Using the flatness of DC-Drives to emulate a generator for a decoupled MPC using a geometric approach for motion control in Robotino
  23. Distinguishing state variability from trait change in longitudinal data
  24. An Improved Approach to the Semi-Process-Oriented Implementation of Standardised ERP-Systems
  25. Evaluation of Time/Phase Parameters in Frequency Measurements for Inertial Navigation Systems
  26. Machine Learning and Knowledge Discovery in Databases
  27. A denoising procedure using wavelet packets for instantaneous detection of pantograph oscillations
  28. Visualizing the Hidden Activity of Artificial Neural Networks
  29. Clustering Hydrological Homogeneous Regions and Neural Network Based Index Flood Estimation for Ungauged Catchments
  30. Gain Scheduling Controller for Improving Level Control Performance
  31. The role of reading time complexity and reading speed in text comprehension
  32. Mathematics in Robot Control for Theoretical and Applied Problems
  33. Latent structure perceptron with feature induction for unrestricted coreference resolution
  34. Using cross-recurrence quantification analysis to compute similarity measures for time series of unequal length with applications to sleep stage analysis
  35. Understanding the socio-technical aspects of low-code adoption for software development