A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples: A simulation study

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Multilevel structural equation models are increasingly applied in psychological research. With increasing model complexity, estimation becomes computationally demanding, and small sample sizes pose further challenges on estimation methods relying on asymptotic theory. Recent developments of Bayesian estimation techniques may help to overcome the shortcomings of classical estimation techniques. The use of potentially inaccurate prior information may, however, have detrimental effects, especially in small samples. The present Monte Carlo simulation study compares the statistical performance of classical estimation techniques with Bayesian estimation using different prior specifications for a two-level SEM with either continuous or ordinal indicators. Using two software programs (Mplus and Stan), differential effects of between- and within-level sample sizes on estimation accuracy were investigated. Moreover, it was tested to which extent inaccurate priors may have detrimental effects on parameter estimates in categorical indicator models. For continuous indicators, Bayesian estimation did not show performance advantages over ML. For categorical indicators, Bayesian estimation outperformed WLSMV solely in case of strongly informative accurate priors. Weakly informative inaccurate priors did not deteriorate performance of the Bayesian approach, while strong informative inaccurate priors led to severely biased estimates even with large sample sizes. With diffuse priors, Stan yielded better results than Mplus in terms of parameter estimates.
Original languageEnglish
JournalMultivariate Behavioral Research
Volume51
Issue number5
Pages (from-to)661-680
Number of pages20
ISSN0027-3171
DOIs
Publication statusPublished - 02.09.2016

    Research areas

  • Social Work and Social Pedagogics - multilevel structural equation modeling, multilevel item response theory, Bayesian statistics, sample size, Monte Carlo simulation

Recently viewed

Publications

  1. Control of an Electromagnetic Linear Actuator Using Flatness Property and Systems Inversion
  2. Positioning Improvement for a Laser Scanning System using cSORPD control
  3. General management principles and a checklist of strategies to guide forest biodiversity conservation
  4. How mobile app design impacts user responses to mixed self-tracking outcomes
  5. Hydrograph analysis and basef low separation
  6. Ten essentials for action-oriented and second order energy transitions, transformations and climate change research
  7. Understanding and Supporting Management Decision-Making
  8. Doing space in face-to-face interaction and on interactive multimodal platforms
  9. Conditions of One-Way and Two-Way Approaches in Strategic Start-Up Communication
  10. Downsizing, Ideology and Contracts
  11. Collaborative modelling for active involvement of stakeholders in urban flood risk management
  12. Effectiveness of the world network of biosphere reserves in maintaining forest ecosystem functions
  13. Using the Domestication Approach for the Analysis of Diffusion and Participation Processes of New Media
  14. Development and characterisation of a new interface for coupling capillary LC with collision-cell ICPMS and its application for phosphorylation profiling of tryptic protein digests
  15. Interplay of formative assessment and instructional quality—interactive effects on students’ mathematics achievement
  16. Trajectories optimisation for electrical vehicles driven by a three-phase synchronous motor
  17. Optimizing price levels in e-commerce applications
  18. Do You Like What You (Can't) See? The Differential Effects of Hardware and Software Upgrades on High-Tech Product Evaluations
  19. Using Long-Duration Static Stretch Training to Counteract Strength and Flexibility Deficits in Moderately Trained Participants
  20. Exploring Difficult History Lessons, Identity Construction, the Artistic Expansion of Sitcom Storytelling Tools in the Black-ish Episode, "Juneteenth"
  21. Modeling the cost-effectiveness of health care systems for alcohol use disorders
  22. Advancing research on ecosystem service bundles for comparative assessments and synthesis
  23. Establishment age and wages
  24. An Integrative and Comprehensive Methodology for Studying Aesthetic Experience in the Field
  25. The polarity field concept
  26. Sowing density
  27. Analysis of ammonia losses after field application of biogas slurries by an empirical model
  28. Klimapaket
  29. Effects of Soil Properties, Temperature and Disturbance on Diversity and Functional Composition of Plant Communities Along a Steep Elevational Gradient on Tenerife
  30. Managing information in the case of opinion spamming
  31. Perfluorooctanoic acid (PFOA)-main concerns and regulatory developments in Europe from an environmental point of view
  32. Harmony at the Workplace
  33. Liquidity, Flows, Circulation
  34. Introducing the cycling anger scale