A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples: A simulation study

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Multilevel structural equation models are increasingly applied in psychological research. With increasing model complexity, estimation becomes computationally demanding, and small sample sizes pose further challenges on estimation methods relying on asymptotic theory. Recent developments of Bayesian estimation techniques may help to overcome the shortcomings of classical estimation techniques. The use of potentially inaccurate prior information may, however, have detrimental effects, especially in small samples. The present Monte Carlo simulation study compares the statistical performance of classical estimation techniques with Bayesian estimation using different prior specifications for a two-level SEM with either continuous or ordinal indicators. Using two software programs (Mplus and Stan), differential effects of between- and within-level sample sizes on estimation accuracy were investigated. Moreover, it was tested to which extent inaccurate priors may have detrimental effects on parameter estimates in categorical indicator models. For continuous indicators, Bayesian estimation did not show performance advantages over ML. For categorical indicators, Bayesian estimation outperformed WLSMV solely in case of strongly informative accurate priors. Weakly informative inaccurate priors did not deteriorate performance of the Bayesian approach, while strong informative inaccurate priors led to severely biased estimates even with large sample sizes. With diffuse priors, Stan yielded better results than Mplus in terms of parameter estimates.
Original languageEnglish
JournalMultivariate Behavioral Research
Volume51
Issue number5
Pages (from-to)661-680
Number of pages20
ISSN0027-3171
DOIs
Publication statusPublished - 02.09.2016

    Research areas

  • Social Work and Social Pedagogics - multilevel structural equation modeling, multilevel item response theory, Bayesian statistics, sample size, Monte Carlo simulation

Recently viewed

Activities

  1. Changes of teachers' knowledge, beliefs and attitudes regarding inquiry-based learning in the framework of a professional development programme
  2. Co-supervisor of the dissertation "Multi-trophic interactions and functional diversity in biodiversity experiments."
  3. Workshop on Stochastic Models, Statistics and Their Applications 2017
  4. Is a better understanding of assembly a way to help reassemble communities for restoration?
  5. An axiomatic foundation of entropic preferences under Knightian uncertainty
  6. Nordic Seminar on Computational Mechanics - NSCM 2016
  7. How to observe Culture?
  8. It's how, not what we use that matters - Communications Modes in the Internet
  9. Bsc-Thesis: Functional diversity of leaf-litter ants in a tree diversity experiment
  10. Knowledge Spaces
  11. Dealing with temporal tensions in drug development processes
  12. LC-MS identification of the photo-transformation products of desipramine with studying the effect of different environmental variables on the kinetics of their formation
  13. Alternative Mouse – Alternative User? Towards a History of Assistive Media
  14. Coherent behavior in geophysical flows
  15. Coupled component modelling for inter- and transdisciplinariy climate change impact reserach: dimensions of integration and examples of interface design
  16. Monitoring Phenological phases of the crops using TerraSAR-X Spotlight Images based on Factor Analysis
  17. Institute for Advanced Study Princeton
  18. Exploring priority effects in a central European grassland field experiment in order to inform restoration (Symposium)
  19. JoSch - Journal der Schreibberatung (Zeitschrift)

Publications

  1. Human–learning–machines: introduction to a special section on how cybernetics and constructivism inspired new forms of learning
  2. Fast, Fully Automated Analysis of Voriconazole from Serum by LC-LC-ESI-MS-MS with Parallel Column-Switching Technique
  3. The Influence of Note-taking on Mathematical Solution Processes while Working on Reality-Based Tasks
  4. Binary Random Nets II
  5. A cognitive mapping approach to understanding public objection to energy infrastructure
  6. Nonlinear PD fault-tolerant control for dynamic positioning of ships with actuator constraints
  7. A framework for business model development in technology-driven start-ups
  8. Evaluation of standard ERP software implementation approaches in terms of their capability for business process optimization
  9. Understanding the modes of use and availability of critical metals-An expert-based scenario analysis for the case of indium
  10. Machine Learning Applications
  11. Do guided internet-based interventions result in clinically relevant changes for patients with depression?
  12. Networking for the environment
  13. Design of an Information-Based Distributed Production Planning System
  14. Estimation and interpretation of a Heckman selection model with endogenous covariates
  15. The buffering effect of selection, optimization, and compensation strategy use on the relationship between problem solving demands and occupational well-being
  16. Participatory energy scenario development as dramatic scripting
  17. Polar Coordinates and Interactive Learning
  18. Clause identification using entropy guided transformation learning
  19. Introduction: The representative turn in EU studies
  20. Model based logistic monitoring for supply and assembly processes