The Effects of Nonindependent Rater Sets in Multilevel–Multitrait–Multimethod Models

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Multiple ratings are becoming increasingly popular for the assessment of a wide range of behaviors. Teaching evaluation designs and 360-degree feedback often use multiple raters alongside self-ratings. Eid and colleagues (2008) proposed a multilevel structural equation model for the analysis of data stemming from such designs that assumes that raters stem from independent populations of raters. However, it is quite common for raters to rate multiple targets, thus implying a cross-classified data structure. A simulation study was conducted to assess the effects of this rater nonindependence on parameter and standard error estimates in multilevel structural equation models. Results show parameter estimation biases to be small, whereas standard errors pertaining to the Level 1 covariance matrices as well as the mean structure on Level 2 are underestimated.

Original languageEnglish
JournalStructural Equation Modeling
Volume22
Issue number3
Pages (from-to)439-448
Number of pages10
ISSN1070-5511
DOIs
Publication statusPublished - 03.07.2015
Externally publishedYes

Recently viewed

Activities

  1. Labour Economics (Zeitschrift)
  2. Mathematik und Sprache
  3. Development of PE pre-service teachers’ teaching performance during a long-term internship - A mixed-methods analysis of classroom videos and the written self-reflections of the PE pre-service teachers
  4. 15th International Conference on Sensors and Measurement Technology - SENSOR 2011
  5. Tagung "Mathe für alle" 2012
  6. Tourismuspolitischer Dialog - 2013
  7. Deferred Compensation Schemes, Fairness Concerns, and Employment of Older Workers
  8. Research Priorities in Light of the Future Global Action Programme on Education for Sustainable Development
  9. Intercultural Relations in Practice 2017
  10. "Integration on the ground" - Assumptions and Consequences of Neighbourhood Strategies
  11. 19th Annual SemFest
  12. The Predictive Power of Social Media Sentiment for Short-Term Stock Movements
  13. Hyperkult XXV - 2015
  14. Education for Sustainable Adaptation to Climate Change in Tourism Branch. Using Scenarios for Knowledge Transfer
  15. CfP Sektionstagung 2017
  16. Towards a New Aesthetic Paradigm
  17. Manet und die Revolution des Impressionismus
  18. Identifying Global Challenges for Future Tourism and Tourism Management
  19. Podiumsdiskussion zu »Heuschrecken«, Rimini Protokoll
  20. The effect of professional development on teachers’ PCK, on beliefs and on the quality of teaching
  21. Partisanship and Political Affection. The normative and epistemic functions of partisan discourse
  22. Università di Macerata
  23. Foucault trifft Latour
  24. Between Path Dependency and Tourism Area Life Cycle: Cultural Assets in the Light of Spa Re-development in East Germany
  25. Wien Depot: Podiumsdiskussion
  26. Enterprise Resource Planning Systems: New transparency, new opacity
  27. Karlstad Universität
  28. East German Spas: between path dependency and tourism life cycle
  29. Methods for Ph.D.
  30. Die Symbolgrafik als dritter Weg
  31. How important are SDGs for teacher educators? – Engage educators in a global landscape: Mapping the terrain with a case study of a pilot professional development program from Ethiopia