A Multilevel CFA–MTMM Approach for Multisource Feedback Instruments: Presentation and Application of a New Statistical Model

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Jana Mahlke
  • Martin Schultze
  • Tobias Koch
  • Michael Eid
  • Regina Eckert
  • Felix C. Brodbeck

Multisource feedback instruments are a widely used tool in human resource management. However, comprehensive validation studies remain scarce and there is a lack of statistical models that account appropriately for the complex data structure. Because both peers and subordinates are nested within the target but stem from different populations, the assumption of traditional multilevel structural equation models that the sample on a lower level stems from the same population is violated. We present a multilevel confirmatory factor analysis multitrait–multimethod (ML–CFA–MTMM) model that considers this peculiarity of multisource feedback instruments. The model is applied to 2 scales of the Benchmarks® instrument and it is demonstrated how measures of reliability and of convergent and discriminant validity can be obtained using multilevel structural equation modeling software. We discuss the results as well as some implications and guidelines for the use of the model.

Original languageEnglish
JournalStructural Equation Modeling
Volume23
Issue number1
Pages (from-to)91-110
Number of pages20
ISSN1070-5511
DOIs
Publication statusPublished - 02.01.2016
Externally publishedYes

Recently viewed

Publications

  1. Microsimulation - A survey of principles, developments and applications
  2. Depression-specific Costs and their Factors based on SHI Routine data
  3. Performance of the DSM-5-based criteria for Internet addiction
  4. A comprehensive Eulerian modeling framework for airborne mercury species
  5. Quasi-in-situ observation of microstructure at the friction interface
  6. Short run comovement, persistent shocks and the business cycle
  7. Explaining Investment Dynamics: Empirical Evidence from German New Ventures
  8. Editorial: Machine Learning and Data Mining in Materials Science
  9. Migration-Based Multilingualism in the English as a Foreign Language Classroom
  10. Optimization of a gaseous multitube detector for soft X-ray detection
  11. The Economic Value of Clickstream Data From an Advertiser's Perspective
  12. Path dependence and technological expectations in transport policy
  13. Data practices in apps from Brazil: What do privacy policies inform us about?
  14. Utilization of protein-rich residues in biotechnological processes
  15. Swarm Robotics, or: the smartness of 'a bunch of cheap dumb things'
  16. Chapter 9: Particular Remedies for Non-performance: Section 4: Price Reduction
  17. User Authentication via Multifaceted Mouse Movements and Outlier Exposure
  18. A Method to Enhance the Accuracy of Time of Flight Measurement Systems
  19. Detection of significant tracer gases by means of polymer gas sensors
  20. From simulation to real-world robotic mobile fulfillment systems
  21. Developing shaping competence in informal setting at universities
  22. Web-Based Stress Management Program for University Students in Indonesia
  23. A cross-scale assessment of productivity–diversity relationships
  24. On the logic of drawing history from symbols, especially from images
  25. Why the measurement of species diversity requires prior value judgements
  26. A classification of teacher interventions in mathematics teaching
  27. New incremental methods for springback compensation by stress superposition