A Multilevel CFA-MTMM Model for Nested Structurally Different Methods

Research output: Journal contributionsJournal articlesResearchpeer-review

Standard

A Multilevel CFA-MTMM Model for Nested Structurally Different Methods. / Koch, Tobias; Schultze, Martin; Burrus, Jeremy et al.
In: Journal of Educational and Behavioral Statistics, Vol. 40, No. 5, 01.10.2015, p. 477-510.

Research output: Journal contributionsJournal articlesResearchpeer-review

Harvard

APA

Vancouver

Koch T, Schultze M, Burrus J, Roberts RD, Eid M. A Multilevel CFA-MTMM Model for Nested Structurally Different Methods. Journal of Educational and Behavioral Statistics. 2015 Oct 1;40(5):477-510. doi: 10.3102/1076998615606109

Bibtex

@article{d4003f9d59d547a6bfbde3d08c166da6,
title = "A Multilevel CFA-MTMM Model for Nested Structurally Different Methods",
abstract = "The numerous advantages of structural equation modeling (SEM) for the analysis of multitrait–multimethod (MTMM) data are well known. MTMM-SEMs allow researchers to explicitly model the measurement error, to examine the true convergent and discriminant validity of the given measures, and to relate external variables to the latent trait as well as the latent method factors in the model. According to Eid et al. (2008) different MTMM measurement designs require different types of MTMM-SEMs. Eid et al. (2008) proposed three different MTMM-SEMs for measurement designs with (a) structurally different methods, (b) interchangeable methods, and (c) a combination of both types of methods. In the present work, we extend this taxonomy to a multilevel correlated traits–correlated methods minus one [CTC(M−1)] model for nested structurally different methods. The new model enables researchers to study method effects on both measurement levels (i.e., within and between clusters, classes, schools, etc.) and evaluate the convergent and discriminant validity of the measures. The statistical performance of the model is examined by a simulation study, and recommendations for the application of the model are given.",
keywords = "Sociology, MTMM analysis, multilevel structural equation modeling, structurally different and interchangeable methods",
author = "Tobias Koch and Martin Schultze and Jeremy Burrus and Roberts, {Richard D.} and Michael Eid",
year = "2015",
month = oct,
day = "1",
doi = "10.3102/1076998615606109",
language = "English",
volume = "40",
pages = "477--510",
journal = "Journal of Educational and Behavioral Statistics",
issn = "1076-9986",
publisher = "SAGE Publications Inc.",
number = "5",

}

RIS

TY - JOUR

T1 - A Multilevel CFA-MTMM Model for Nested Structurally Different Methods

AU - Koch, Tobias

AU - Schultze, Martin

AU - Burrus, Jeremy

AU - Roberts, Richard D.

AU - Eid, Michael

PY - 2015/10/1

Y1 - 2015/10/1

N2 - The numerous advantages of structural equation modeling (SEM) for the analysis of multitrait–multimethod (MTMM) data are well known. MTMM-SEMs allow researchers to explicitly model the measurement error, to examine the true convergent and discriminant validity of the given measures, and to relate external variables to the latent trait as well as the latent method factors in the model. According to Eid et al. (2008) different MTMM measurement designs require different types of MTMM-SEMs. Eid et al. (2008) proposed three different MTMM-SEMs for measurement designs with (a) structurally different methods, (b) interchangeable methods, and (c) a combination of both types of methods. In the present work, we extend this taxonomy to a multilevel correlated traits–correlated methods minus one [CTC(M−1)] model for nested structurally different methods. The new model enables researchers to study method effects on both measurement levels (i.e., within and between clusters, classes, schools, etc.) and evaluate the convergent and discriminant validity of the measures. The statistical performance of the model is examined by a simulation study, and recommendations for the application of the model are given.

AB - The numerous advantages of structural equation modeling (SEM) for the analysis of multitrait–multimethod (MTMM) data are well known. MTMM-SEMs allow researchers to explicitly model the measurement error, to examine the true convergent and discriminant validity of the given measures, and to relate external variables to the latent trait as well as the latent method factors in the model. According to Eid et al. (2008) different MTMM measurement designs require different types of MTMM-SEMs. Eid et al. (2008) proposed three different MTMM-SEMs for measurement designs with (a) structurally different methods, (b) interchangeable methods, and (c) a combination of both types of methods. In the present work, we extend this taxonomy to a multilevel correlated traits–correlated methods minus one [CTC(M−1)] model for nested structurally different methods. The new model enables researchers to study method effects on both measurement levels (i.e., within and between clusters, classes, schools, etc.) and evaluate the convergent and discriminant validity of the measures. The statistical performance of the model is examined by a simulation study, and recommendations for the application of the model are given.

KW - Sociology

KW - MTMM analysis

KW - multilevel structural equation modeling

KW - structurally different and interchangeable methods

UR - http://www.scopus.com/inward/record.url?scp=84945303884&partnerID=8YFLogxK

U2 - 10.3102/1076998615606109

DO - 10.3102/1076998615606109

M3 - Journal articles

AN - SCOPUS:84945303884

VL - 40

SP - 477

EP - 510

JO - Journal of Educational and Behavioral Statistics

JF - Journal of Educational and Behavioral Statistics

SN - 1076-9986

IS - 5

ER -

DOI

Recently viewed

Activities

  1. Structure and dynamics laboratory testing of an indirectly controlled full variable valve train for camless engines
  2. Trajectory-based computational study of coherent behavior in flows
  3. From Text to Data: AI and Human Expertise in Provenance Linked Open Data
  4. Trajectory-based Lagrangian approaches for the extraction and characterization of coherent structures
  5. Presentation of the paper entitled "Comparison of Backpropagation and Kalman Filter-based Training for Neural Networks"
  6. Plenary lecture entitled: "Wavelet Packets for Applications in Signal Processing and Control Systems"
  7. Short course on numerical methods for stochastic processes
  8. I Am Behind the Screen: Understanding the Invisible Work of Content Moderators on Digital Platforms
  9. Nordic Seminar on Computational Mechanics - NSCM 2016
  10. Presentation of the paper entitled: "Classical PI Controllers with Anti-Windup Techniques Applied on Level Systems: An Interesting Case Study"
  11. 27st IEEE International Conference on Methods and Models in Automation an Robotics (MMAR)
  12. It's Time to Talk About Time Shaping Competence: A Framework for Addressing “Time” in ESE
  13. Towards a fully-automated adaptive e-learning environment: A predictive model for difficulty generating factors in gap-filling activities that target English tense-aspect-mood
  14. Fuzzy based control of a nonholonomic car-like robot for drive assistant systems
  15. SON 2020+2: International Workshop on Dynamics, Optimization, and Computation
  16. Unit Root & Cointegration Testing Conference 2005

Publications

  1. An MPC for an Aggregate Actuator with a Self-Tuning Feedforward Control
  2. Making an Impression Through Openness
  3. Building a process layer for business applications using the blackboard pattern
  4. Emergency detection based on probabilistic modeling in AAL environments
  5. Global text processing in CSCL with learning protocols
  6. Unity and diversity in the law of state responsibility
  7. N3 - A collection of datasets for named entity recognition and disambiguation in the NLP interchange format
  8. Multi-Parallel Sending Coils for Movable Receivers in Inductive Charging Systems
  9. Anomaly detection in formed sheet metals using convolutional autoencoders
  10. Control of a Sun Tracking Robot Based on Adaptive Sliding Mode Control with Kalman Filtering and Model Predictive Control
  11. Anatomy of Haar Wavelet Filter and Its Implementation for Signal Processing
  12. Introducing a multivariate model for predicting driving performance
  13. Reading and Calculating in Word Problem Solving
  14. 'SPREAD THE APP, NOT THE VIRUS’ – AN EXTENSIVE SEM-APPROACH TO UNDERSTAND PANDEMIC TRACING APP USAGE IN GERMANY
  15. Simultaneous Constrained Adaptive Item Selection for Group-Based Testing
  16. Inversion of fuzzy neural networks for the reduction of noise in the control loop
  17. Age-related differences in processing visual device and task characteristics when using technical devices
  18. Enhancing Performance of Level System Modeling with Pseudo-Random Signals
  19. Neural Combinatorial Optimization on Heterogeneous Graphs
  20. Transformer with Tree-order Encoding for Neural Program Generation
  21. Lyapunov Convergence Analysis for Asymptotic Tracking Using Forward and Backward Euler Approximation of Discrete Differential Equations
  22. Mathematics in Robot Control for Theoretical and Applied Problems
  23. PI and Fuzzy Controllers for Non-Linear Systems
  24. Analysis And Comparison Of Dispatching RuleBased Scheduling In Dual-Resource Constrained Shop-Floor Scenarios
  25. Exploration strategies, performance, and error consequences when learning a complex computer task
  26. Lessons learned for spatial modelling of ecosystem services in support of ecosystem accounting
  27. How to support synchronous net-based learning discourses
  28. Construct Objectification and De-Objectification in Organization Theory
  29. Development and validation of a method for the determination of trace alkylphenols and phthalates in the atmosphere