The Effects of Nonindependent Rater Sets in Multilevel–Multitrait–Multimethod Models

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Multiple ratings are becoming increasingly popular for the assessment of a wide range of behaviors. Teaching evaluation designs and 360-degree feedback often use multiple raters alongside self-ratings. Eid and colleagues (2008) proposed a multilevel structural equation model for the analysis of data stemming from such designs that assumes that raters stem from independent populations of raters. However, it is quite common for raters to rate multiple targets, thus implying a cross-classified data structure. A simulation study was conducted to assess the effects of this rater nonindependence on parameter and standard error estimates in multilevel structural equation models. Results show parameter estimation biases to be small, whereas standard errors pertaining to the Level 1 covariance matrices as well as the mean structure on Level 2 are underestimated.

Original languageEnglish
JournalStructural Equation Modeling
Volume22
Issue number3
Pages (from-to)439-448
Number of pages10
ISSN1070-5511
DOIs
Publication statusPublished - 03.07.2015
Externally publishedYes

Recently viewed

Publications

  1. Soziale Netzwerke im Internet
  2. Differential mortality rates in major and subthreshold depression
  3. Non-acceptances in context
  4. Assessing tree dendrometrics in young regenerating plantations using terrestrial laser scanning
  5. University-linked programmes for sustainable entrepreneurship and regional development
  6. Designing and evaluating a crew resource management training for manufacturing industries
  7. Digitized Evaluation of Academic Opportunities to Learn (OTLs) Concerning Linguistically Responsive Teaching (LRT)
  8. Current issues in competence modeling and assessment
  9. COMMONSIM
  10. Modemacher
  11. Tormentil for active ulcerative colitis
  12. Composing with the terra fluida of interaction: new paths for CCO research as relational practice
  13. The 'need for speed'
  14. Introduction
  15. Exploring the Use of the Pronoun I in German Academic Texts with Machine Learning
  16. Information rigidities, inflation perceptions, and the media
  17. Inexistent Ink
  18. The pace of life for forest trees
  19. "Helden des Alltags"
  20. The hidden hand that shapes conceptual understanding: Choosing effective representations for teaching cell division and climate change
  21. Implementation of a balanced scorecard for hybrid business models
  22. Mapping and analysing historical indicators of ecosystem services in Germany
  23. Entrepreneurial actions
  24. Life-protecting neoliberalism
  25. Who likes to learn new things: measuring adult motivation to learn with PIAAC data from 21 countries
  26. Moving Around Myanmar
  27. The recent double paradigm shift in restoration ecology
  28. Moderators of intergroup evaluation in disadvantaged groups