A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples: A simulation study

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Multilevel structural equation models are increasingly applied in psychological research. With increasing model complexity, estimation becomes computationally demanding, and small sample sizes pose further challenges on estimation methods relying on asymptotic theory. Recent developments of Bayesian estimation techniques may help to overcome the shortcomings of classical estimation techniques. The use of potentially inaccurate prior information may, however, have detrimental effects, especially in small samples. The present Monte Carlo simulation study compares the statistical performance of classical estimation techniques with Bayesian estimation using different prior specifications for a two-level SEM with either continuous or ordinal indicators. Using two software programs (Mplus and Stan), differential effects of between- and within-level sample sizes on estimation accuracy were investigated. Moreover, it was tested to which extent inaccurate priors may have detrimental effects on parameter estimates in categorical indicator models. For continuous indicators, Bayesian estimation did not show performance advantages over ML. For categorical indicators, Bayesian estimation outperformed WLSMV solely in case of strongly informative accurate priors. Weakly informative inaccurate priors did not deteriorate performance of the Bayesian approach, while strong informative inaccurate priors led to severely biased estimates even with large sample sizes. With diffuse priors, Stan yielded better results than Mplus in terms of parameter estimates.
Original languageEnglish
JournalMultivariate Behavioral Research
Volume51
Issue number5
Pages (from-to)661-680
Number of pages20
ISSN0027-3171
DOIs
Publication statusPublished - 02.09.2016

    Research areas

  • Social Work and Social Pedagogics - multilevel structural equation modeling, multilevel item response theory, Bayesian statistics, sample size, Monte Carlo simulation

Recently viewed

Publications

  1. A PHENOMENOGRAPHICAL STUDY OF CHILDRENS’ SPATIAL THOUGHT WHILE USING MAPS IN REAL SPACES
  2. Intersection tests for the cointegrating rank in dependent panel data
  3. Challenges and boundaries in implementing social return on investment
  4. Is too much help an obstacle? Effects of interactivity and cognitive style on learning with dynamic versus non-dynamic visualizations with narrative explanations
  5. Volume of Imbalance Container Prediction using Kalman Filter and Long Short-Term Memory
  6. Faulty Process Detection Using Machine Learning Techniques
  7. Investigation and modeling of the material behavior due to evolving dislocation microstructures in fcc and bcc metals
  8. Universal Threshold Calculation for Fingerprinting Decoders using Mixture Models
  9. Explaining and controlling for the psychometric properties of computer-generated figural matrix items
  10. A framework for business model development in technology-driven start-ups
  11. TRY plant trait database – enhanced coverage and open access
  12. Passive Peak Voltage Sensor for Multiple Sending Coils Inductive Power Transmission System
  13. Experiences of the Self between Limit, Transgression, and the Explosion of the Dialectical System
  14. Probabilistic approach to modelling of recession curves
  15. A Hermeneutic Interpretation of Concepts in a Cooperative Multicultural Working Project
  16. Introduction
  17. Are criminals better lie detectors? Investigating offenders' abilities in the context of deception detection
  18. Reciprocal Relationships Between Dispositional Optimism and Work Experiences
  19. Evaluation of standard ERP software implementation approaches in terms of their capability for business process optimization
  20. Errors in Working with Office Computers
  21. Does thinking-aloud affect learning, visual information processing and cognitive load when learning with seductive details as expected from self-regulation perspective?
  22. An Outcome-Oriented, Social-Ecological Framework for Assessing Protected Area Effectiveness
  23. Intraspecific trait variation increases species diversity in a trait-based grassland model
  24. Towards a spatial understanding of identity play
  25. Media-Assisted Foreign Language Learning - Concepts and Functions
  26. Effects of diversity versus segregation on automatic approach and avoidance behavior towards own and other ethnic groups
  27. Improve a 3D distance measurement accuracy in stereo vision systems using optimization methods’ approach
  28. The Open Anchoring Quest Dataset: Anchored Estimates from 96 Studies on Anchoring Effects
  29. Grazing effects on intraspecific trait variability vary with changing precipitation patterns in Mongolian rangelands
  30. Doing space in face-to-face interaction and on interactive multimodal platforms
  31. Using Conjoint Analysis to Elicit Preferences for Occupational Health Services in Small and Microenterprises
  32. Noise level estimation and detection