A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples: A simulation study

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Multilevel structural equation models are increasingly applied in psychological research. With increasing model complexity, estimation becomes computationally demanding, and small sample sizes pose further challenges on estimation methods relying on asymptotic theory. Recent developments of Bayesian estimation techniques may help to overcome the shortcomings of classical estimation techniques. The use of potentially inaccurate prior information may, however, have detrimental effects, especially in small samples. The present Monte Carlo simulation study compares the statistical performance of classical estimation techniques with Bayesian estimation using different prior specifications for a two-level SEM with either continuous or ordinal indicators. Using two software programs (Mplus and Stan), differential effects of between- and within-level sample sizes on estimation accuracy were investigated. Moreover, it was tested to which extent inaccurate priors may have detrimental effects on parameter estimates in categorical indicator models. For continuous indicators, Bayesian estimation did not show performance advantages over ML. For categorical indicators, Bayesian estimation outperformed WLSMV solely in case of strongly informative accurate priors. Weakly informative inaccurate priors did not deteriorate performance of the Bayesian approach, while strong informative inaccurate priors led to severely biased estimates even with large sample sizes. With diffuse priors, Stan yielded better results than Mplus in terms of parameter estimates.
Original languageEnglish
JournalMultivariate Behavioral Research
Volume51
Issue number5
Pages (from-to)661-680
Number of pages20
ISSN0027-3171
DOIs
Publication statusPublished - 02.09.2016

    Research areas

  • Social Work and Social Pedagogics - multilevel structural equation modeling, multilevel item response theory, Bayesian statistics, sample size, Monte Carlo simulation

Recently viewed

Activities

  1. SPARQL Querying Benchmarks
  2. Preliminary selection of experimental techniques in Subtask D
  3. Planar Multipole Resonance Probe: Comparison of a Functional Analytic Approach and Full 3D Electromagnetic Field Simulations
  4. Cognitive predictors of accurate syntax/semantics mapping in the early stages of adult L2 learning
  5. From Music Scenes to Ecosystems? Concepts, Challenges and Current Developments within Scene Perspectives
  6. Tracking, Targeting, Predicting: Epistemological, Ontological and Biopolitical Dimensions of Techno-Security - 2013
  7. What we know about conceptual learning in open inquiry settings in science education
  8. International Conference on Methods and Models in Automation an Robotics - MMAR 2016
  9. A piezo servo hydraulic actuator for use in camless combustion engines and its control with MPC
  10. Alterations of a visual and how they work for and at the boundaries of an interorganizational team: A multimodal exploration
  11. Improving the quality of selecting applicants for university student programs
  12. Plenary lecture entitled: "Wavelet Packets for Applications in Signal Processing and Control Systems"
  13. Mapping participation in public environmental decision-making processes: An international database on published case studies
  14. Do connectives improve the level of understandability in mathematical modeling tasks?
  15. Simulation and Evaluation of Control Mechanisms for Mobile Robot Fulfillment Systems
  16. Is there only one modelling competency? The question of situated cognition when solving real world problems

Publications

  1. Semantic Parsing for Knowledge Graph Question Answering with Large Language Models
  2. Enhancing the Building Information Modeling Lifecycle of Complex Structures with IoT
  3. Teachers’ use of data from digital learning platforms for instructional design
  4. Control versus Complexity
  5. Control of an Electromagnetic Linear Actuator Using Flatness Property and Systems Inversion
  6. Comparing the performance of computational estimation methods for physicochemical properties of dimethylsiloxanes and selected siloxanols
  7. A tutorial introduction to adaptive fractal analysis
  8. Mathematics in Robot Control for Theoretical and Applied Problems
  9. Dynamically changing sequencing rules with reinforcement learning in a job shop system with stochastic influences
  10. Challenges in detecting proximal effects of existential threat on lie detection accuracy
  11. Machine Learning and Knowledge Discovery in Databases
  12. Soft Optimal Computing Methods to Identify Surface Roughness in Manufacturing Using a Monotonic Regressor
  13. A sensor fault detection scheme as a functional safety feature for DC-DC converters
  14. Long-term memory predictors of adult language learning at the interface between syntactic form and meaning
  15. Visualization of the Plasma Frequency by means of a Particle Simulation using a Normalized Periodic Model
  16. Evaluating structural and compositional canopy characteristics to predict the light-demand signature of the forest understorey in mixed, semi-natural temperate forests
  17. Simple saturated relay non-linear PD control for uncertain motion systems with friction and actuator constraint
  18. Nonlinear PD fault-tolerant control for dynamic positioning of ships with actuator constraints
  19. On the origin of passive rotation in rotational joints, and how to calculate it
  20. Kalman Filter for Predictive Maintenance and Anomaly Detection
  21. A Switching Cascade Sliding PID-PID Controllers Combined with a Feedforward and an MPC for an Actuator in Camless Internal Combustion Engines
  22. Dynamic Lot Size Optimization with Reinforcement Learning
  23. Comparison of different FEM codes approach for extrusion process analysis
  24. Robust decoupling through algebraic output feedback in manipulation systems