Explaining and controlling for the psychometric properties of computer-generated figural matrix items

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Figural matrix items are a popular task type for assessing general intelligence (Spearman's g). Items of this kind can be constructed rationally, allowing the implementation of computerized generation algorithms. In this study, the influence of different task parameters on the degree of difficulty in matrix items was investigated. A sample of N = 169 participants (all age groups) completed a set of 25 automatically generated 4 × 4 matrix items. Data collection was conducted through the World Wide Web. All items showed a good fit with the Rasch model, and item difficulty could be explained reasonably well through the implemented task parameters. The research indicated that matrix items can easily be generated using well-defined computerized algorithms. Their composite character explains item difficulty to a satisfactory degree and enables researchers to construct items with anticipated psychometric properties and Rasch model conformity. Practical advantages of these findings are pointed out.
Original languageEnglish
JournalApplied Psychological Measurement
Volume32
Issue number3
Pages (from-to)195-210
Number of pages16
ISSN0146-6216
DOIs
Publication statusPublished - 05.2008
Externally publishedYes

    Research areas

  • Psychology - automatic item generation, figural matrix items, item task parameters, LLTM, Rasch model

DOI

Recently viewed

Activities

  1. Transdisciplinary Evaluation of Alternative Adaptation Strategies Value-Tree Method as a Tool to Integrate Multiple Values of Science, Practice and the General Public into Decision-Making
  2. Material Migrations I Online Lecture Series
  3. It's how, not what we use that matters - Communications Modes in the Internet
  4. Uncertainty and Subjectivity in Provenance Linked Open Data
  5. Using the Multiple Streams Framework and the Multi-Level Perspective to Explain Policy Transformation: The Case of the German Energiewende
  6. Seed dispersal and predation: Interactions, ecosystem functions and services
  7. Continuous Innovation through Modular Upgradeability: How Software Upgrades Affect Consumer Product Valuations
  8. Swarming. Science Fact and Science Fiction of Distributed Intelligence
  9. Validation of school inspection frameworks and methods
  10. Spas in the New Länder: A Transformation with an Uncertain Outcome
  11. Is there a threshold effect of time headway on subjective variables for different velocities?
  12. The Impact of Explicit References in Computer Supported Collaborative Learning: Evidence from Eye Movement Analyses
  13. Alterations of a visual and how they work for and at the boundaries of an interorganizational team: A multimodal exploration
  14. Memory Acts: Memory without Representation.: Theoretical and Methodological Suggestions
  15. Self-tuning of a kalman filter applied in a DC drive and in a kalman-based sensor
  16. Language Policy and Language Learning: New Paradigms and New Challenges - LPLL 2009
  17. Dealing with temporal tensions in drug development processes
  18. Draw the line? How boundary creation behaviors at the end of work relate to recovery and next-day work performance
  19. Es geht um
  20. LC-MS identification of the photo-transformation products of desipramine with studying the effect of different environmental variables on the kinetics of their formation

Publications

  1. Metaphors and Paradigms of the Language Animal—or—The Advantage of seeing “Time Is a Resource” as a Paradigm
  2. Text Comprehension as a Mediator in Solving Mathematical Reality-Based Tasks
  3. Use of Machine-Learning Algorithms Based on Text, Audio and Video Data in the Prediction of Anxiety and Post-Traumatic Stress in General and Clinical Populations
  4. What would Colin say?
  5. Teachers’ use of data from digital learning platforms for instructional design
  6. How Much Home Office is Ideal? A Multi-Perspective Algorithm
  7. Dimension estimates for certain sets of infinite complex continued fractions
  8. Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood
  9. Is too much help an obstacle? Effects of interactivity and cognitive style on learning with dynamic versus non-dynamic visualizations with narrative explanations
  10. Visualizing the Hidden Activity of Artificial Neural Networks
  11. Q-Adaptive Control of the nonlinear dynamics of the cantilever-sample system of an Atomic Force Microscope
  12. How, when and why do negotiators use reference points?
  13. An observer for sensorless variable valve control in camless internal combustion engines
  14. Using conditional inference trees and random forests to predict the bioaccumulation potential of organic chemicals
  15. Visualization of the Plasma Frequency by means of a Particle Simulation using a Normalized Periodic Model
  16. Assembly Modes of General Planar 3-RPR Parallel Mechanisms when Using the Linear Actuators’ Orientations
  17. Hypertext
  18. Special Issue in Acquisitional Pragmatics in Foreign Language Learning
  19. Distributed robust Gaussian Process regression
  20. Assessment of cognitive load in multimedia learning using dual-task methodology
  21. Diffusion patterns in small vs. large capital markets-the case of value-based management
  22. A MODEL FOR QUANTIFICATION OF SOFTWARE COMPLEXITY
  23. Mathematical relation between extended connectivity and eigenvector coefficients.
  24. Artificial Intelligence in Foreign Language Learning and Teaching
  25. Assembly Theory for Restoring Ecosystem Structure and Functioning
  26. A tutorial introduction to adaptive fractal analysis