A Multilevel CFA–MTMM Approach for Multisource Feedback Instruments: Presentation and Application of a New Statistical Model
Research output: Journal contributions › Journal articles › Research › peer-review
Standard
In: Structural Equation Modeling, Vol. 23, No. 1, 02.01.2016, p. 91-110.
Research output: Journal contributions › Journal articles › Research › peer-review
Harvard
APA
Vancouver
Bibtex
}
RIS
TY - JOUR
T1 - A Multilevel CFA–MTMM Approach for Multisource Feedback Instruments
T2 - Presentation and Application of a New Statistical Model
AU - Mahlke, Jana
AU - Schultze, Martin
AU - Koch, Tobias
AU - Eid, Michael
AU - Eckert, Regina
AU - Brodbeck, Felix C.
PY - 2016/1/2
Y1 - 2016/1/2
N2 - Multisource feedback instruments are a widely used tool in human resource management. However, comprehensive validation studies remain scarce and there is a lack of statistical models that account appropriately for the complex data structure. Because both peers and subordinates are nested within the target but stem from different populations, the assumption of traditional multilevel structural equation models that the sample on a lower level stems from the same population is violated. We present a multilevel confirmatory factor analysis multitrait–multimethod (ML–CFA–MTMM) model that considers this peculiarity of multisource feedback instruments. The model is applied to 2 scales of the Benchmarks® instrument and it is demonstrated how measures of reliability and of convergent and discriminant validity can be obtained using multilevel structural equation modeling software. We discuss the results as well as some implications and guidelines for the use of the model.
AB - Multisource feedback instruments are a widely used tool in human resource management. However, comprehensive validation studies remain scarce and there is a lack of statistical models that account appropriately for the complex data structure. Because both peers and subordinates are nested within the target but stem from different populations, the assumption of traditional multilevel structural equation models that the sample on a lower level stems from the same population is violated. We present a multilevel confirmatory factor analysis multitrait–multimethod (ML–CFA–MTMM) model that considers this peculiarity of multisource feedback instruments. The model is applied to 2 scales of the Benchmarks® instrument and it is demonstrated how measures of reliability and of convergent and discriminant validity can be obtained using multilevel structural equation modeling software. We discuss the results as well as some implications and guidelines for the use of the model.
KW - confirmatory factor analysis
KW - convergent and discriminant validity
KW - method effects
KW - multisource feedback
KW - multisource feedback Related articles
KW - confirmatory factor analysis
KW - convergent and discriminant validity
KW - Social Work and Social Pedagogics
UR - http://www.scopus.com/inward/record.url?scp=84933056370&partnerID=8YFLogxK
U2 - 10.1080/10705511.2014.990153
DO - 10.1080/10705511.2014.990153
M3 - Journal articles
VL - 23
SP - 91
EP - 110
JO - Structural Equation Modeling
JF - Structural Equation Modeling
SN - 1070-5511
IS - 1
ER -