A Multilevel CFA–MTMM Approach for Multisource Feedback Instruments: Presentation and Application of a New Statistical Model

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Jana Mahlke
  • Martin Schultze
  • Tobias Koch
  • Michael Eid
  • Regina Eckert
  • Felix C. Brodbeck

Multisource feedback instruments are a widely used tool in human resource management. However, comprehensive validation studies remain scarce and there is a lack of statistical models that account appropriately for the complex data structure. Because both peers and subordinates are nested within the target but stem from different populations, the assumption of traditional multilevel structural equation models that the sample on a lower level stems from the same population is violated. We present a multilevel confirmatory factor analysis multitrait–multimethod (ML–CFA–MTMM) model that considers this peculiarity of multisource feedback instruments. The model is applied to 2 scales of the Benchmarks® instrument and it is demonstrated how measures of reliability and of convergent and discriminant validity can be obtained using multilevel structural equation modeling software. We discuss the results as well as some implications and guidelines for the use of the model.

Original languageEnglish
JournalStructural Equation Modeling
Volume23
Issue number1
Pages (from-to)91-110
Number of pages20
ISSN1070-5511
DOIs
Publication statusPublished - 02.01.2016
Externally publishedYes

Recently viewed

Publications

  1. Cost effectiveness of guided Internet-based interventions for depression in comparison with control conditions
  2. Walk counts, labyrinthicity, and complexity of acyclic and cyclic graphs and molecules.
  3. High resolution measurement of physical variables change for INS
  4. Deterministic Pod Repositioning in Robotic Mobile Fulfillment Systems
  5. Embracing scale-dependence to achieve a deeper understanding of biodiversity and its change across communities
  6. No Concept of form within Sight Can System Theory help us?
  7. Self-perceived quality of life predicts mortality risk better than a multi-biomarker panel, but the combination of both does best
  8. Contextualizing the relationship between self-commitment and performance
  9. Turning Good Intentions Into Actions by Using the Health Action Process Approach to Predict Adherence to Internet-Based Depression Prevention
  10. Comparison of Supervised versus Self-Administered Stretching on Bench Press Maximal Strength and Force Development
  11. CubeQA—question answering on RDF data cubes
  12. Distributable Modular Software Framework for Manufacturing Systems
  13. Putting adaptive planning into practice: A meta-analysis of current applications
  14. Achieving enhanced mechanical properties in Mg-Gd-Y-Zn-Mn alloy by altering dynamic recrystallization behavior via pre-ageing treatment
  15. Beyond academic discourse
  16. Almost-invariant and finite-time coherent sets
  17. Sharing in Christ's rule
  18. A common European asylum system? How variation in Member States’ administrative capacity undermines EU asylum harmonisation
  19. Effect of erbium modification on the microstructure, mechanical and corrosion characteristics of binary Mg-Al alloys
  20. Comment on “Stretching intervention can prevent muscle injuries: a systematic review and meta-analysis”
  21. Meta-Image – a collaborative environment for the image discourse