A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples: A simulation study

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Multilevel structural equation models are increasingly applied in psychological research. With increasing model complexity, estimation becomes computationally demanding, and small sample sizes pose further challenges on estimation methods relying on asymptotic theory. Recent developments of Bayesian estimation techniques may help to overcome the shortcomings of classical estimation techniques. The use of potentially inaccurate prior information may, however, have detrimental effects, especially in small samples. The present Monte Carlo simulation study compares the statistical performance of classical estimation techniques with Bayesian estimation using different prior specifications for a two-level SEM with either continuous or ordinal indicators. Using two software programs (Mplus and Stan), differential effects of between- and within-level sample sizes on estimation accuracy were investigated. Moreover, it was tested to which extent inaccurate priors may have detrimental effects on parameter estimates in categorical indicator models. For continuous indicators, Bayesian estimation did not show performance advantages over ML. For categorical indicators, Bayesian estimation outperformed WLSMV solely in case of strongly informative accurate priors. Weakly informative inaccurate priors did not deteriorate performance of the Bayesian approach, while strong informative inaccurate priors led to severely biased estimates even with large sample sizes. With diffuse priors, Stan yielded better results than Mplus in terms of parameter estimates.
Original languageEnglish
JournalMultivariate Behavioral Research
Volume51
Issue number5
Pages (from-to)661-680
Number of pages20
ISSN0027-3171
DOIs
Publication statusPublished - 02.09.2016

    Research areas

  • Social Work and Social Pedagogics - multilevel structural equation modeling, multilevel item response theory, Bayesian statistics, sample size, Monte Carlo simulation

Recently viewed

Publications

  1. Simulation based comparison of safety-stock calculation methods
  2. Using sequential injection analysis for fast determination of phosphate in coastal waters
  3. Using Wikipedia for Cross-Language Named Entity Recognition
  4. Promising practices for dealing with complexity in research for development
  5. A denoising procedure using wavelet packets for instantaneous detection of pantograph oscillations
  6. XOperator - An extensible semantic agent for instant messaging networks
  7. Don’t underestimate the problems of user centredness in software development projectsthere are many!?
  8. Integration of Environmental Management Information Systems and ERP systems using Integration Platforms
  9. Enhancing the Building Information Modeling Lifecycle of Complex Structures with IoT
  10. Continuous and Discrete Concepts for Detecting Transport Barriers in the Planar Circular Restricted Three Body Problem
  11. Energy Optimization in Motion Planning of a Two-Link Manipulator using Bernstein Polynomials
  12. Trajectory-based computational study of coherent behavior in flows
  13. Teachers’ use of data from digital learning platforms for instructional design
  14. Control versus Complexity
  15. Q-Adaptive Control of the nonlinear dynamics of the cantilever-sample system of an Atomic Force Microscope
  16. Control of an Electromagnetic Linear Actuator Using Flatness Property and Systems Inversion
  17. A PHENOMENOGRAPHICAL STUDY OF CHILDRENS’ SPATIAL THOUGHT WHILE USING MAPS IN REAL SPACES
  18. Switching between reading tasks leads to phase-transitions in reading times in L1 and L2 readers
  19. Children's use of spatial skills in solving two map-reading tasks in real space.
  20. Selecting and Adapting Methods for Analysis and Design in Value-Sensitive Digital Social Innovation Projects: Toward Design Principles
  21. The effects of different on-line adaptive response time limits on speed and amount of learning in computer assisted instruction and intelligent tutoring
  22. Design and Control of an Inductive Power Transmission System with AC-AC Converter for a Constant Output Current
  23. Control of a Three-Axis Robot with Super Twisting Sliding Mode Control
  24. Convolutional Neural Networks
  25. Intersection tests for the cointegrating rank in dependent panel data
  26. Topic Embeddings – A New Approach to Classify Very Short Documents Based on Predefined Topics
  27. Reading and Calculating in Word Problem Solving
  28. On robustness properties in permanent magnet machine control by using decoupling controller