How to get really smart: Modeling retest and training effects in ability testing using computer-generated figural matrix items

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

The interpretation of retest scores is problematic because they are potentially affected by measurement and predictive bias, which impact construct validity, and because their size differs as a function of various factors. This paper investigates the construct stability of scores on a figural matrices test and models retest effects at the level of the individual test taker as a function of covariates (simple retest vs. training, use of identical vs. parallel retest forms, and general mental ability). A total of N=189 subjects took two tests of matrix items that were automatically generated according to a strict construction rationale. Between test administrations, participants in the intervention groups received training, while controls did not. The Rasch model fit the data at both time points, but there was a lack of item difficulty parameter invariance across time. Training increased test performance beyond simple retesting, but there was no large difference between the identical and parallel retest forms at the individual level. Individuals varied greatly in how they profited from retest experience, training, and the use of identical vs. parallel retest forms. The results suggest that even with carefully designed tasks, it is problematic to directly compare scores from initial tests and retests. Test administrators should emphasize learning potential instead of state level assessment, and inter-individual differences with regard to test experience should be taken into account when interpreting test results.
OriginalspracheEnglisch
ZeitschriftIntelligence
Jahrgang39
Ausgabenummer4
Seiten (von - bis)233-243
Anzahl der Seiten11
ISSN0160-2896
DOIs
PublikationsstatusErschienen - 07.2011

DOI

Zuletzt angesehen

Publikationen

  1. Contributions of declarative and procedural memory to accuracy and automatization during second language practice
  2. A denoising procedure using wavelet packets for instantaneous detection of pantograph oscillations
  3. A fast sequential injection analysis system for the simultaneous determination of ammonia and phosphate
  4. Robust Flatness Based Control of an Electromagnetic Linear Actuator Using Adaptive PID Controller
  5. Detection of coherent oceanic structures via transfer operators
  6. Closed-form Solution for the Direct Kinematics Problem of the Planar 3-RPR Parallel Mechanism
  7. Trajectory tracking using MPC and a velocity observer for flat actuator systems in automotive applications
  8. Efficacy of an internet and app-based gratitude intervention in reducing repetitive negative thinking and mechanisms of change in the intervention's effect on anxiety and depression
  9. Finding Datasets in Publications: The University of Paderborn Approach
  10. Developing robust field survey protocols in landscape ecology
  11. Effects of plyometric training on postural control in static and dynamic testing situations
  12. Learning from Erroneous Examples
  13. Within-individual leaf trait variation increases with phenotypic integration in a subtropical tree diversity experiment
  14. Introduction
  15. Policy implementation through multi-level governance
  16. Head turn scaling below the threshold of perception in immersive virtual environments
  17. Development and prospects of degradable magnesium alloys for structural and functional applications in the fields of environment and energy
  18. Belief in free will affects causal attributions when judging others’ behavior
  19. A switching observer for sensorless control of an electromagnetic valve actuator for camless internal combustion engines
  20. What is intergovernmental about the EU’s ‘(new) intergovernmentalist’ turn? Evidence from the Eurozone and asylum crises
  21. How context affects transdisciplinary research
  22. »CO2 causes a hole in the atmosphere« Using laypeople’s conceptions as a starting point to communicate climate change
  23. From 'one right way' to 'one ruinous way'? Discursive shifts in 'There is no alternative'
  24. Material system analysis
  25. Social group membership does not modulate automatic imitation in a contrastive multi-agent paradigm
  26. System and action theory
  27. Inter- and intraspecific consumer trait variations determine consumer diversity effects in multispecies predator−prey systems
  28. Anisotropic wavelet bases and thresholding
  29. Formalised and Non-Formalised Methods in Resource Management-Knowledge and Social Learning in Participatory Processes
  30. Developing a die casting magnesium alloy with excellent mechanical performance by controlling intermetallic phase
  31. An analysis of the requirements for DSS on integrated river basin management
  32. Proof of concept
  33. Effects of different video- or text-based reflection stimuli on pre-service teachers’ emotions, immersion, cognitive load and knowledge-based reasoning