A Multilevel CFA–MTMM Approach for Multisource Feedback Instruments: Presentation and Application of a New Statistical Model

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Jana Mahlke
  • Martin Schultze
  • Tobias Koch
  • Michael Eid
  • Regina Eckert
  • Felix C. Brodbeck

Multisource feedback instruments are a widely used tool in human resource management. However, comprehensive validation studies remain scarce and there is a lack of statistical models that account appropriately for the complex data structure. Because both peers and subordinates are nested within the target but stem from different populations, the assumption of traditional multilevel structural equation models that the sample on a lower level stems from the same population is violated. We present a multilevel confirmatory factor analysis multitrait–multimethod (ML–CFA–MTMM) model that considers this peculiarity of multisource feedback instruments. The model is applied to 2 scales of the Benchmarks® instrument and it is demonstrated how measures of reliability and of convergent and discriminant validity can be obtained using multilevel structural equation modeling software. We discuss the results as well as some implications and guidelines for the use of the model.

Original languageEnglish
JournalStructural Equation Modeling
Volume23
Issue number1
Pages (from-to)91-110
Number of pages20
ISSN1070-5511
DOIs
Publication statusPublished - 02.01.2016
Externally publishedYes

Recently viewed

Publications

  1. Application of design of experiments for laser shock peening process optimization
  2. Explicit references in chat-based CSCL
  3. Interactive Media as Fields of Transduction
  4. On the role of linguistic features for comprehension and learning from STEM texts. A meta-analysis
  5. Developing robust field survey protocols in landscape ecology
  6. Challenging the status quo of accelerator research: Concluding remarks
  7. Effects of accuracy feedback on fractal characteristics of time estimation
  8. Hot tearing behaviour of binary Mg-1Al alloy using a contraction force measuring method
  9. Modeling Individual Differences in Children’s Information Integration During Pragmatic Word Learning
  10. Plant density modifies root system architecture in spring barley (Hordeum vulgare L.) through a change in nodal root number
  11. Towards a dynamic value network perspective of sustainable business models
  12. Modeling a modular omnidirectional AGV developmental platform with integrated suspension and power-plant
  13. Life Cycle Assessment of Consumption Patterns – Understanding the links between changing social practices and environmental impacts
  14. On the Difficulty of Forgetting
  15. MICSIM: Concept, Developments, and Applications of a PC Microsimulation Model for Research and Teaching
  16. Understanding the modes of use and availability of critical metals-An expert-based scenario analysis for the case of indium
  17. Walk counts, labyrinthicity, and complexity of acyclic and cyclic graphs and molecules.
  18. The reception of trust in different legal systems: some lessons for Vietnam; a comparative study