A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples: A simulation study

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Multilevel structural equation models are increasingly applied in psychological research. With increasing model complexity, estimation becomes computationally demanding, and small sample sizes pose further challenges on estimation methods relying on asymptotic theory. Recent developments of Bayesian estimation techniques may help to overcome the shortcomings of classical estimation techniques. The use of potentially inaccurate prior information may, however, have detrimental effects, especially in small samples. The present Monte Carlo simulation study compares the statistical performance of classical estimation techniques with Bayesian estimation using different prior specifications for a two-level SEM with either continuous or ordinal indicators. Using two software programs (Mplus and Stan), differential effects of between- and within-level sample sizes on estimation accuracy were investigated. Moreover, it was tested to which extent inaccurate priors may have detrimental effects on parameter estimates in categorical indicator models. For continuous indicators, Bayesian estimation did not show performance advantages over ML. For categorical indicators, Bayesian estimation outperformed WLSMV solely in case of strongly informative accurate priors. Weakly informative inaccurate priors did not deteriorate performance of the Bayesian approach, while strong informative inaccurate priors led to severely biased estimates even with large sample sizes. With diffuse priors, Stan yielded better results than Mplus in terms of parameter estimates.
Original languageEnglish
JournalMultivariate Behavioral Research
Volume51
Issue number5
Pages (from-to)661-680
Number of pages20
ISSN0027-3171
DOIs
Publication statusPublished - 02.09.2016

    Research areas

  • Social Work and Social Pedagogics - multilevel structural equation modeling, multilevel item response theory, Bayesian statistics, sample size, Monte Carlo simulation

Recently viewed

Publications

  1. A Note on Estimation of Empirical Models for Margins of Exports with Unknown Non-linear Functional Forms
  2. Introduction
  3. Overcoming Multi-legacy Application Challenges through Building Dynamic Capabilities for Low-Code Adoption
  4. Consequences of extreme weather events for developing countries based on the example of Mongolia
  5. Effect of grain size and structure, solid solution elements, precipitates and twinning on nanohardness of Mg-Re alloys
  6. Buckling Analysis under Uncertainty
  7. On-board pneumatic pressure generation methods for soft robotics applications
  8. Signal, Material, Sampling
  9. Kurzprosa
  10. Effectiveness of digital cognitive behavioral therapy for insomnia in nurses with shift work sleep disorder
  11. Lernprotokollunterstütztes Lernen - ein Vergleich zwischen unstrukturiertem und systemkontrolliertem diskursivem Lernen im Netz
  12. Der Zentrale Runde Tisch der DDR: Wortprotokoll und Dokumente
  13. With a little help from my website. Firm survival and web presence in times of COVID-19 - Evidence from 10 European countries
  14. The role of scenarios in fostering collective action for sustainable development
  15. Preserving Soils for Life
  16. Applying thematic analysis to analyse press coverage in cross-country comparative research
  17. Relationen im Raum
  18. Berufsorientierte Schreibkompetenz mithilfe von SRSD fördern
  19. Schlechte Haut
  20. Wie WIR unsere Welt globalisieren
  21. Small patches can be valuable for biodiversity conservation: two case studies on birds in southeastern Australia
  22. Sufficiency as relations of enoughness
  23. Handball in Angriff nehmen
  24. Adopters build bridges: Changing the institutional logic for more sustainable cities
  25. Rationalitätskritik
  26. General Ecology
  27. The Role of a Women’s Collective in Rebuilding Livelihoods After a Disaster
  28. Was hat uns bloß so ruiniert?