The Meaning of Higher-Order Factors in Reflective-Measurement Models

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Higher-order factor analysis is a widely used approach for analyzing the structure of a multi-dimensional test. Whenever first-order factors are correlated researchers are tempted to apply ahigher-order factor model. But is this reasonable? What do the higher-order factors measure?What is their meaning? Willoughby, Holochwost, Blanton, and Blair (this issue) discuss thisimportant issue for the measurement of executive functions. They came to the conclusion that for-mative measurement structure might be more appropriate than a reflective measurement structurewith higher-order factors. Willoughby et al. refer to 4 decision rules for selecting a measurementmodel presented by Jarvis, MacKenzie and Podsakoff (2003). Whereas the rules of Jarvis et al.are based on plausibility arguments, we would like to go a step further and show that stochasticmeasurement theory offers a clear and well-defined theoretical basis for defining a measurementmodel. In our comment we will discuss how stochastic measurement theory can be used to iden-tify conditions under which it is possible to define higher-order factors as random variables ina well-defined random experiment. In particular, we will show that for defining second-orderfactors it is necessary to have a multilevel sampling process with respect to executive functions.We will argue that this random experiment has not been realized for the measurement of exec-utive functions and that the assumption of second-order or even higher-order factors would notbe reasonable for theoretical reasons. Finally, we will discuss the implications of this reasoningfor the measurement of executive functions and other areas of measurement. We will start withthe definition of first-order factors, and then we will discuss the necessary conditions for definingsecond-order factors.
Original languageEnglish
JournalMeasurement
Volume12
Issue number3
Pages (from-to)96-101
Number of pages6
ISSN1536-6367
DOIs
Publication statusPublished - 22.08.2014
Externally publishedYes

Recently viewed

Publications

  1. Towards a socio-cognitive approach to knowledge transfer
  2. Variational Pragmatics
  3. The importance of product lifetime labelling for purchase decisions
  4. Foliar Endophytic Fungal Communities Are Driven by Leaf Traits—Evidence From a Temperate Tree Diversity Experiment
  5. Principals between exploitation and exploration
  6. Neuro-Symbolic Relation Extraction
  7. Establishment age and wages
  8. Tree and mycorrhizal fungal diversity drive intraspecific and intraindividual trait variation in temperate forests
  9. Mindfulness as an intervention to improve self-control
  10. Navigating (In)Visibility
  11. Analysis of Cognitively Activating Tasks in Vocational Education and Training of Nursing
  12. Aufgeschoben, nicht aufgehoben
  13. Composing with the terra fluida of interaction: new paths for CCO research as relational practice
  14. The conservation against development paradigm in protected areas
  15. Possible underestimations of risks for the environment due to unregulated emissions of biocides from households to wastewater
  16. Why Emergency? Reflections on the Practice and Rhetoric of Exceptionalism
  17. Powers of Abstraction
  18. Front, Field, Line, Plane
  19. A Kalman estimator for detecting repetitive disturbances
  20. Circularity in Automotive Electronics Design
  21. Effectiveness of an Internet- and App-Based Intervention for College Students With Elevated Stress
  22. Temporal variability in native plant composition clouds impact of increasing non-native richness along elevational gradients in Tenerife
  23. Effects of Soil Properties, Temperature and Disturbance on Diversity and Functional Composition of Plant Communities Along a Steep Elevational Gradient on Tenerife
  24. A cultural approach toward the notion of the instrument
  25. Temporal discrimination as a function of marker duration
  26. Der Strukturgitter-Ansatz
  27. Contributions of Net-Map to sustainability action research
  28. Work Design and Performance
  29. Rechtschreiben unterrichten
  30. Entry, Exit and Productivity
  31. It Matters to Whom You Compare Yourself
  32. 'I Cannot Overreach the Senate': Orienting to the Macro-Context of Legislative Debates of the Nigerian Senate