A Multilevel CFA-MTMM Model for Nested Structurally Different Methods

Research output: Journal contributionsJournal articlesResearchpeer-review

Standard

A Multilevel CFA-MTMM Model for Nested Structurally Different Methods. / Koch, Tobias; Schultze, Martin; Burrus, Jeremy et al.
In: Journal of Educational and Behavioral Statistics, Vol. 40, No. 5, 01.10.2015, p. 477-510.

Research output: Journal contributionsJournal articlesResearchpeer-review

Harvard

APA

Vancouver

Koch T, Schultze M, Burrus J, Roberts RD, Eid M. A Multilevel CFA-MTMM Model for Nested Structurally Different Methods. Journal of Educational and Behavioral Statistics. 2015 Oct 1;40(5):477-510. doi: 10.3102/1076998615606109

Bibtex

@article{d4003f9d59d547a6bfbde3d08c166da6,
title = "A Multilevel CFA-MTMM Model for Nested Structurally Different Methods",
abstract = "The numerous advantages of structural equation modeling (SEM) for the analysis of multitrait–multimethod (MTMM) data are well known. MTMM-SEMs allow researchers to explicitly model the measurement error, to examine the true convergent and discriminant validity of the given measures, and to relate external variables to the latent trait as well as the latent method factors in the model. According to Eid et al. (2008) different MTMM measurement designs require different types of MTMM-SEMs. Eid et al. (2008) proposed three different MTMM-SEMs for measurement designs with (a) structurally different methods, (b) interchangeable methods, and (c) a combination of both types of methods. In the present work, we extend this taxonomy to a multilevel correlated traits–correlated methods minus one [CTC(M−1)] model for nested structurally different methods. The new model enables researchers to study method effects on both measurement levels (i.e., within and between clusters, classes, schools, etc.) and evaluate the convergent and discriminant validity of the measures. The statistical performance of the model is examined by a simulation study, and recommendations for the application of the model are given.",
keywords = "Sociology, MTMM analysis, multilevel structural equation modeling, structurally different and interchangeable methods",
author = "Tobias Koch and Martin Schultze and Jeremy Burrus and Roberts, {Richard D.} and Michael Eid",
year = "2015",
month = oct,
day = "1",
doi = "10.3102/1076998615606109",
language = "English",
volume = "40",
pages = "477--510",
journal = "Journal of Educational and Behavioral Statistics",
issn = "1076-9986",
publisher = "SAGE Publications Inc.",
number = "5",

}

RIS

TY - JOUR

T1 - A Multilevel CFA-MTMM Model for Nested Structurally Different Methods

AU - Koch, Tobias

AU - Schultze, Martin

AU - Burrus, Jeremy

AU - Roberts, Richard D.

AU - Eid, Michael

PY - 2015/10/1

Y1 - 2015/10/1

N2 - The numerous advantages of structural equation modeling (SEM) for the analysis of multitrait–multimethod (MTMM) data are well known. MTMM-SEMs allow researchers to explicitly model the measurement error, to examine the true convergent and discriminant validity of the given measures, and to relate external variables to the latent trait as well as the latent method factors in the model. According to Eid et al. (2008) different MTMM measurement designs require different types of MTMM-SEMs. Eid et al. (2008) proposed three different MTMM-SEMs for measurement designs with (a) structurally different methods, (b) interchangeable methods, and (c) a combination of both types of methods. In the present work, we extend this taxonomy to a multilevel correlated traits–correlated methods minus one [CTC(M−1)] model for nested structurally different methods. The new model enables researchers to study method effects on both measurement levels (i.e., within and between clusters, classes, schools, etc.) and evaluate the convergent and discriminant validity of the measures. The statistical performance of the model is examined by a simulation study, and recommendations for the application of the model are given.

AB - The numerous advantages of structural equation modeling (SEM) for the analysis of multitrait–multimethod (MTMM) data are well known. MTMM-SEMs allow researchers to explicitly model the measurement error, to examine the true convergent and discriminant validity of the given measures, and to relate external variables to the latent trait as well as the latent method factors in the model. According to Eid et al. (2008) different MTMM measurement designs require different types of MTMM-SEMs. Eid et al. (2008) proposed three different MTMM-SEMs for measurement designs with (a) structurally different methods, (b) interchangeable methods, and (c) a combination of both types of methods. In the present work, we extend this taxonomy to a multilevel correlated traits–correlated methods minus one [CTC(M−1)] model for nested structurally different methods. The new model enables researchers to study method effects on both measurement levels (i.e., within and between clusters, classes, schools, etc.) and evaluate the convergent and discriminant validity of the measures. The statistical performance of the model is examined by a simulation study, and recommendations for the application of the model are given.

KW - Sociology

KW - MTMM analysis

KW - multilevel structural equation modeling

KW - structurally different and interchangeable methods

UR - http://www.scopus.com/inward/record.url?scp=84945303884&partnerID=8YFLogxK

U2 - 10.3102/1076998615606109

DO - 10.3102/1076998615606109

M3 - Journal articles

AN - SCOPUS:84945303884

VL - 40

SP - 477

EP - 510

JO - Journal of Educational and Behavioral Statistics

JF - Journal of Educational and Behavioral Statistics

SN - 1076-9986

IS - 5

ER -

DOI

Recently viewed

Activities

  1. Reconsidering performativity in alternativity: Forward an otative management science
  2. Alterations of a visual and how they work for and at the boundaries of an interorganizational team: A multimodal exploration
  3. Managing the present generations’ conflicts on the backs of future generations: How current generation’s negotiators create and claim value for themselves and future others
  4. Learning Processes in a Video-based Learning Environment: What do teachers think and feel when they observe their own teaching or that of others?
  5. Thinking of Time - A Resource which Should be Allocated Equally
  6. Emerging Visions of Seamless Travel: (En)Countering Camouflaged Sovereignty at the Frictionless Border
  7. Enacting clan crime through the production of statistical security knowledge
  8. Sustainability Transformation: Building Resilience in Sustainability Reporting for a Net-Zero Future
  9. Do mindsets make a difference? Professionalizing teachers for inclusive language learning environments
  10. Dissertation "Contested Constitutions: Constitutional Design, Conflict and Change in Post-Communist East Central Europe"
  11. (Re)Constructing a Sociology Of the Arts In the 21th Century: Problems and Perspectives - Inserting "Space" In The Sociology Of The Arts
  12. Shifting Regimes of Proof: On the Contested Politics of Identification in Border and Migration Management
  13. Simulation Project 2.0: Electing the U.S. President in a Web-Based EFL Scenario. Task, Processes Outcomes
  14. The 6th International CSR Communication Conference - 2022
  15. Provenance: Can You Bank on It?
  16. Don't ask don't tell - impact after nuclear accidents on provisioning ecosystem services

Publications

  1. Stepwise-based optimizing approaches for arrangements of loudspeaker in multi-zone sound field reproduction
  2. Fast, Fully Automated Analysis of Voriconazole from Serum by LC-LC-ESI-MS-MS with Parallel Column-Switching Technique
  3. Overcoming Multi-legacy Application Challenges through Building Dynamic Capabilities for Low-Code Adoption
  4. Metrics for Experimentation Programs: Categories, Benefits and Challenges
  5. The explanatory power of Carnegie Classification in predicting engagement indicators
  6. The erosion of relational values resulting from landscape simplification
  7. Peter Hay, Advanced Introduction to Private International Law and Procedure
  8. Locus of control
  9. Arc spraying of WCFeCSiMn cored wires.
  10. Process limits of extrusion of multimaterial components
  11. Comparison of different machine control modes during friction extrusion of AA2024
  12. Simulation of stresses during casting of binary magnesium-aluminum alloys
  13. Why Emergency? Reflections on the Practice and Rhetoric of Exceptionalism
  14. Die Schreibwerkstatt Mehrsprachigkeit
  15. Gas-Kampf oder Gas-Krampf
  16. Tschick
  17. Strategy execution in higher education
  18. The theory of human development
  19. The causal effects of exports on firm size and labor productivity
  20. Efficacy of a Web-Based Stress Management Intervention for Beginning Teachers on Reducing Stress and Mechanisms of Change
  21. Between Usability and Trustworthiness-The Potential of Information Transfer Using Digital Information Platforms for Refugees
  22. Learning from Indigenous Populations and Local Communities
  23. Telling your own stories