A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples: A simulation study

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Standard

A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples: A simulation study. / Holtmann, Jana; Koch, Tobias; Lochner, Katharina et al.
in: Multivariate Behavioral Research, Jahrgang 51, Nr. 5, 02.09.2016, S. 661-680.

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Harvard

APA

Vancouver

Bibtex

@article{838197da39304d64861dc158dc6296c0,
title = "A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples: A simulation study",
abstract = "Multilevel structural equation models are increasingly applied in psychological research. With increasing model complexity, estimation becomes computationally demanding, and small sample sizes pose further challenges on estimation methods relying on asymptotic theory. Recent developments of Bayesian estimation techniques may help to overcome the shortcomings of classical estimation techniques. The use of potentially inaccurate prior information may, however, have detrimental effects, especially in small samples. The present Monte Carlo simulation study compares the statistical performance of classical estimation techniques with Bayesian estimation using different prior specifications for a two-level SEM with either continuous or ordinal indicators. Using two software programs (Mplus and Stan), differential effects of between- and within-level sample sizes on estimation accuracy were investigated. Moreover, it was tested to which extent inaccurate priors may have detrimental effects on parameter estimates in categorical indicator models. For continuous indicators, Bayesian estimation did not show performance advantages over ML. For categorical indicators, Bayesian estimation outperformed WLSMV solely in case of strongly informative accurate priors. Weakly informative inaccurate priors did not deteriorate performance of the Bayesian approach, while strong informative inaccurate priors led to severely biased estimates even with large sample sizes. With diffuse priors, Stan yielded better results than Mplus in terms of parameter estimates.",
keywords = "Social Work and Social Pedagogics, multilevel structural equation modeling, multilevel item response theory, Bayesian statistics, sample size, Monte Carlo simulation",
author = "Jana Holtmann and Tobias Koch and Katharina Lochner and Michael Eid",
year = "2016",
month = sep,
day = "2",
doi = "10.1080/00273171.2016.1208074",
language = "English",
volume = "51",
pages = "661--680",
journal = "Multivariate Behavioral Research",
issn = "0027-3171",
publisher = "Psychology Press Ltd",
number = "5",

}

RIS

TY - JOUR

T1 - A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples: A simulation study

AU - Holtmann, Jana

AU - Koch, Tobias

AU - Lochner, Katharina

AU - Eid, Michael

PY - 2016/9/2

Y1 - 2016/9/2

N2 - Multilevel structural equation models are increasingly applied in psychological research. With increasing model complexity, estimation becomes computationally demanding, and small sample sizes pose further challenges on estimation methods relying on asymptotic theory. Recent developments of Bayesian estimation techniques may help to overcome the shortcomings of classical estimation techniques. The use of potentially inaccurate prior information may, however, have detrimental effects, especially in small samples. The present Monte Carlo simulation study compares the statistical performance of classical estimation techniques with Bayesian estimation using different prior specifications for a two-level SEM with either continuous or ordinal indicators. Using two software programs (Mplus and Stan), differential effects of between- and within-level sample sizes on estimation accuracy were investigated. Moreover, it was tested to which extent inaccurate priors may have detrimental effects on parameter estimates in categorical indicator models. For continuous indicators, Bayesian estimation did not show performance advantages over ML. For categorical indicators, Bayesian estimation outperformed WLSMV solely in case of strongly informative accurate priors. Weakly informative inaccurate priors did not deteriorate performance of the Bayesian approach, while strong informative inaccurate priors led to severely biased estimates even with large sample sizes. With diffuse priors, Stan yielded better results than Mplus in terms of parameter estimates.

AB - Multilevel structural equation models are increasingly applied in psychological research. With increasing model complexity, estimation becomes computationally demanding, and small sample sizes pose further challenges on estimation methods relying on asymptotic theory. Recent developments of Bayesian estimation techniques may help to overcome the shortcomings of classical estimation techniques. The use of potentially inaccurate prior information may, however, have detrimental effects, especially in small samples. The present Monte Carlo simulation study compares the statistical performance of classical estimation techniques with Bayesian estimation using different prior specifications for a two-level SEM with either continuous or ordinal indicators. Using two software programs (Mplus and Stan), differential effects of between- and within-level sample sizes on estimation accuracy were investigated. Moreover, it was tested to which extent inaccurate priors may have detrimental effects on parameter estimates in categorical indicator models. For continuous indicators, Bayesian estimation did not show performance advantages over ML. For categorical indicators, Bayesian estimation outperformed WLSMV solely in case of strongly informative accurate priors. Weakly informative inaccurate priors did not deteriorate performance of the Bayesian approach, while strong informative inaccurate priors led to severely biased estimates even with large sample sizes. With diffuse priors, Stan yielded better results than Mplus in terms of parameter estimates.

KW - Social Work and Social Pedagogics

KW - multilevel structural equation modeling

KW - multilevel item response theory

KW - Bayesian statistics

KW - sample size

KW - Monte Carlo simulation

UR - http://www.scopus.com/inward/record.url?scp=84984906875&partnerID=8YFLogxK

U2 - 10.1080/00273171.2016.1208074

DO - 10.1080/00273171.2016.1208074

M3 - Journal articles

C2 - 27594086

VL - 51

SP - 661

EP - 680

JO - Multivariate Behavioral Research

JF - Multivariate Behavioral Research

SN - 0027-3171

IS - 5

ER -

DOI

Zuletzt angesehen

Publikationen

  1. Accuracy, latency, and confidence in abstract reasoning: The influence of fear of failure and gender
  2. Improvements in Flexibility depend on Stretching Duration
  3. Why a Systematic Investigation of Production Planning and Control Procedures is Needed for the Target-oriented Configuration of PPC
  4. Developing shaping competence in informal setting at universities
  5. Utilization of protein-rich residues in biotechnological processes
  6. Horizontal, but not vertical canopy structure is related to stand functional diversity in a subtropical slope forest
  7. Introduction
  8. Structuring multiple perspectives in environmental decision-making
  9. Set oriented computation of transport rates in 3-degree of freedom systems
  10. Deactivation and transformation products in biodegradability testing of ß-lactams amoxicillin and piperacillin
  11. Optimum parameters and rate-controlling mechanisms for hot working of extruded Mg-3Sn-1Ca alloy
  12. Portrait of a Thinker
  13. Actor analysis as a tool for exploring the decision-making processes in environmental governance
  14. Are survey expectations theory-consistent?
  15. SH-CoDE: Scholarly Hybrid Complex Question Decomposition and Execution
  16. Children's use of strategies in estimating length and capacity
  17. Entwicklung und realisierung eines computer-basierten lernprogramms zur GMP-schulung/Programm-entwicklung und benutzer-akzeptanz
  18. Use
  19. The multipole resonance probe: Evolution of a plasma sensor
  20. §50 Windenergie auf See
  21. In-House Experimentation Platforms
  22. Sustainable engineering education in research and practice
  23. Tipping points ahead? How laypeople respond to linear versus nonlinear climate change predictions
  24. Which children can find a way through a strange town using a streetmap?-results of an empirical study on children's orientation competence
  25. Impacts of software and its engineering on the carbon footprint of ICT
  26. A Kinetic Approach to the study of Ideal Multipole Resonance Probe
  27. Regionalism and Diffusion Revisited
  28. AmQA