The Meaning of Higher-Order Factors in Reflective-Measurement Models

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Higher-order factor analysis is a widely used approach for analyzing the structure of a multi-dimensional test. Whenever first-order factors are correlated researchers are tempted to apply ahigher-order factor model. But is this reasonable? What do the higher-order factors measure?What is their meaning? Willoughby, Holochwost, Blanton, and Blair (this issue) discuss thisimportant issue for the measurement of executive functions. They came to the conclusion that for-mative measurement structure might be more appropriate than a reflective measurement structurewith higher-order factors. Willoughby et al. refer to 4 decision rules for selecting a measurementmodel presented by Jarvis, MacKenzie and Podsakoff (2003). Whereas the rules of Jarvis et al.are based on plausibility arguments, we would like to go a step further and show that stochasticmeasurement theory offers a clear and well-defined theoretical basis for defining a measurementmodel. In our comment we will discuss how stochastic measurement theory can be used to iden-tify conditions under which it is possible to define higher-order factors as random variables ina well-defined random experiment. In particular, we will show that for defining second-orderfactors it is necessary to have a multilevel sampling process with respect to executive functions.We will argue that this random experiment has not been realized for the measurement of exec-utive functions and that the assumption of second-order or even higher-order factors would notbe reasonable for theoretical reasons. Finally, we will discuss the implications of this reasoningfor the measurement of executive functions and other areas of measurement. We will start withthe definition of first-order factors, and then we will discuss the necessary conditions for definingsecond-order factors.
Original languageEnglish
JournalMeasurement
Volume12
Issue number3
Pages (from-to)96-101
Number of pages6
ISSN1536-6367
DOIs
Publication statusPublished - 22.08.2014
Externally publishedYes

Recently viewed

Publications

  1. "The (real) world is not enough:" Motivational drivers and user behavior in virtual worlds
  2. Comparison of different machine control modes during friction extrusion of AA2024
  3. Towards a Deconstruction of the Screen
  4. How to Explain Major Policy Change Towards Sustainability? Bringing Together the Multiple Streams Framework and the Multilevel Perspective on Socio-Technical Transitions to Explore the German “Energiewende”
  5. Political embedding of climate assemblies. How effective strategies for policy impact depend on context
  6. Using the Rapid Impact Assessment Matrix to synthesize biofuel and bioenergy impact assessment results
  7. Temporal variations of perfluoroalkyl substances and polybrominated diphenyl ethers in alpine snow
  8. Conventional teaching vs. e-learning
  9. Contextualising urban experimentation
  10. Wasted compliance strategies? The policy-making styles of Hungary and Poland in the implementation of European environmental directives
  11. Elektroaltgeräte
  12. Ubiquitous Memory
  13. A mixed-methods study of the impact of sociocultural adaptation on the development of pragmatic production
  14. The rhetorical structure of marketisation in selected emails of tertiary institutions
  15. Reintegration strategies in a gender perspective
  16. ChatGPT and Its Genre Competence
  17. Costs of Inaction and Costs of Action in Climate Protection
  18. Academic discipline and risk perception of technologies
  19. Krise oder goldenes Zeitalter?
  20. Effect of calcium addition on the hot working behavior of as-cast AZ31 magnesium alloy
  21. Cross-National Complementarity of Technology Push, Demand Pull, and Manufacturing Push Policies
  22. Everyone’s Going to be an Architect
  23. Assessing quality in cross-country comparisons of health systems and policies
  24. Fabian Nitschkowski & Paul Geisler
  25. Creep and hot working behavior of a new magnesium alloy Mg-3Sn-2Ca
  26. Network measures of mixing