How to get really smart: Modeling retest and training effects in ability testing using computer-generated figural matrix items

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

The interpretation of retest scores is problematic because they are potentially affected by measurement and predictive bias, which impact construct validity, and because their size differs as a function of various factors. This paper investigates the construct stability of scores on a figural matrices test and models retest effects at the level of the individual test taker as a function of covariates (simple retest vs. training, use of identical vs. parallel retest forms, and general mental ability). A total of N=189 subjects took two tests of matrix items that were automatically generated according to a strict construction rationale. Between test administrations, participants in the intervention groups received training, while controls did not. The Rasch model fit the data at both time points, but there was a lack of item difficulty parameter invariance across time. Training increased test performance beyond simple retesting, but there was no large difference between the identical and parallel retest forms at the individual level. Individuals varied greatly in how they profited from retest experience, training, and the use of identical vs. parallel retest forms. The results suggest that even with carefully designed tasks, it is problematic to directly compare scores from initial tests and retests. Test administrators should emphasize learning potential instead of state level assessment, and inter-individual differences with regard to test experience should be taken into account when interpreting test results.
OriginalspracheEnglisch
ZeitschriftIntelligence
Jahrgang39
Ausgabenummer4
Seiten (von - bis)233-243
Anzahl der Seiten11
ISSN0160-2896
DOIs
PublikationsstatusErschienen - 07.2011

DOI

Zuletzt angesehen

Publikationen

  1. Development of a quality assurance framework for the open source development model
  2. Spatial mislocalization as a consequence of sequential coding of stimuli
  3. Discourse Analyses in Chat-based CSCL with Learning Protocols
  4. Using mixture distribution models to test the construct validity of the Physical Self-Description Questionnaire
  5. Expertise in research integration and implementation for tackling complex problems
  6. Isocodal and isospectral points, edges, and pairs in graphs and how to cope with them in computerized symmetry recognition
  7. A discrete approximate solution for the asymptotic tracking problem in affine nonlinear systems
  8. Semi-supervised learning for structured output variables
  9. Ambient Intelligence and Knowledge Processing in Distributed Autonomous AAL-Components
  10. Framework for setting up and operating biobanks
  11. Anatomy of Haar Wavelet Filter and Its Implementation for Signal Processing
  12. Introducing a multivariate model for predicting driving performance
  13. Trajectory-based computational study of coherent behavior in flows
  14. Enhancing Performance of Level System Modeling with Pseudo-Random Signals
  15. Neural Combinatorial Optimization on Heterogeneous Graphs
  16. Concept for Process Parameter-Based Inline Quality Control as a Basis for Pairing in a Production Line
  17. On robustness properties in permanent magnet machine control by using decoupling controller
  18. Kinematic self-calibration of non-contact five-axis measuring machine using improved genetic algorithm.
  19. Modelling tasks—The relation between linguistic skills, intra-mathematical skills, and context-related prior knowledge
  20. A transfer operator based computational study of mixing processes in open flow systems
  21. Volume of Imbalance Container Prediction using Kalman Filter and Long Short-Term Memory
  22. Patching Together a Global Script
  23. Distinguishing state variability from trait change in longitudinal data
  24. An Improved Approach to the Semi-Process-Oriented Implementation of Standardised ERP-Systems
  25. Evaluation of Time/Phase Parameters in Frequency Measurements for Inertial Navigation Systems
  26. A Quality Data Model Based on Asset Administration Shell Technology to Enable Autonomous Quality Control Loops
  27. Machine Learning and Knowledge Discovery in Databases
  28. Visualizing the Hidden Activity of Artificial Neural Networks
  29. Clustering Hydrological Homogeneous Regions and Neural Network Based Index Flood Estimation for Ungauged Catchments
  30. 'SPREAD THE APP, NOT THE VIRUS’ – AN EXTENSIVE SEM-APPROACH TO UNDERSTAND PANDEMIC TRACING APP USAGE IN GERMANY
  31. Gain Scheduling Controller for Improving Level Control Performance
  32. Four Methods to Distinguish between Fractal Dimensions in Time Series through Recurrence Quantification Analysis
  33. The elicitation process in developing of case library for Case-Based Reasoner system whilst consideration for validating electronic communication technologies
  34. The role of reading time complexity and reading speed in text comprehension
  35. A denoising procedure using wavelet packets for instantaneous detection of pantograph oscillations
  36. Informatik
  37. Mathematics in Robot Control for Theoretical and Applied Problems
  38. Latent structure perceptron with feature induction for unrestricted coreference resolution
  39. Using cross-recurrence quantification analysis to compute similarity measures for time series of unequal length with applications to sleep stage analysis