A Multilevel CFA–MTMM Approach for Multisource Feedback Instruments: Presentation and Application of a New Statistical Model

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Jana Mahlke
  • Martin Schultze
  • Tobias Koch
  • Michael Eid
  • Regina Eckert
  • Felix C. Brodbeck

Multisource feedback instruments are a widely used tool in human resource management. However, comprehensive validation studies remain scarce and there is a lack of statistical models that account appropriately for the complex data structure. Because both peers and subordinates are nested within the target but stem from different populations, the assumption of traditional multilevel structural equation models that the sample on a lower level stems from the same population is violated. We present a multilevel confirmatory factor analysis multitrait–multimethod (ML–CFA–MTMM) model that considers this peculiarity of multisource feedback instruments. The model is applied to 2 scales of the Benchmarks® instrument and it is demonstrated how measures of reliability and of convergent and discriminant validity can be obtained using multilevel structural equation modeling software. We discuss the results as well as some implications and guidelines for the use of the model.

Original languageEnglish
JournalStructural Equation Modeling
Volume23
Issue number1
Pages (from-to)91-110
Number of pages20
ISSN1070-5511
DOIs
Publication statusPublished - 02.01.2016
Externally publishedYes

Recently viewed

Publications

  1. Interactive Media as Fields of Transduction
  2. Predicting recurrent chat contact in a psychological intervention for the youth using natural language processing
  3. Self-perceived quality of life predicts mortality risk better than a multi-biomarker panel, but the combination of both does best
  4. Internet and computer based interventions for cannabis use
  5. Optimal control strategies for PMSM with a decoupling super twisting SMC and inductance estimation in the presence of saturation
  6. A Two-Stage Sliding-Mode High-Gain Observer to Reduce Uncertainties and Disturbances Effects for Sensorless Control in Automotive Applications
  7. A Configurational Approach to Investigating the Relationship Between Organizational Culture and Organizational Effectiveness Using Fuzzy-Set Analysis
  8. Sensorless Control of AC Motor Drives with Adaptive Extended Kalman Filter
  9. Geometric Properties on the Perfect Decoupling Disturbance Control in Manufacturing Systems
  10. Validity claims in context
  11. Work availability types and well-being in Germany–a latent class analysis among a nationally representative sample
  12. The challenges of gamifying CSR communication
  13. Like! You saved #energy today. Fostering Energy Efficiency in Buildings – The implementation of social media patterns as symbols in Building Management Systems‘ Graphical User Interfaces using Peirce’s semeiosis as a communication concept
  14. Diversity: Konzept. Programmatik. Praxis.
  15. A transfer operator based numerical investigation of coherent structures in three-dimensional Southern ocean circulation
  16. Using (Quantitative) Structure-Activity Relationships in Pharmaceutical Risk Assessment
  17. Schreibberatung
  18. Development and criterion validity of differentiated and elevated vocational interests in adolescence
  19. Considering Teachers’ Beliefs, Motivation, and Emotions Regarding Teaching Mathematics With Digital Tools
  20. A Transatlantic Symposium on the Restatement (Fourth)
  21. Principals between exploitation and exploration
  22. Sustainable Development
  23. Interpersonal Physiological Synchrony Predicts Group Cohesion
  24. Der "fachdidaktische Code" der Lebenswelt- und/oder (?) Situationsorientierung
  25. Glancing into the Applied Tool Box
  26. Credit Constraints and the Extensive Margins of Exports
  27. About the Sense of Useless Software