A Meta-Analytical Multilevel Reliability Generalization of Situational Judgment Tests (SJTs)

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

During the past 20 years, Situational Judgment Tests (SJTs) have developed into a viable tool in personnel selection. Despite their growing popularity, research examining the extent of measurement error is widely lacking. Using reliability generalization, the aim of this article was twofold: (1) establish an estimate for an average coefficient alpha of SJT scores across studies and (2) examine the influence of essential SJT features and selected study variables on score reliability. To handle potential dependent observations a three-level hierarchical linear model was used. The results indicate that the reliability of SJT scores is typically rather low and below recommended levels for highstakes applications. Additionally, both SJT and study characteristics affect score reliability. Implications for practitioners and researchers are provided to guide an appropriate use of SJTs and to initiate future research.

OriginalspracheEnglisch
ZeitschriftEuropean Journal of Psychological Assessment
Jahrgang32
Ausgabenummer3
Seiten (von - bis)230-240
Anzahl der Seiten11
ISSN1015-5759
DOIs
PublikationsstatusErschienen - 07.2016

DOI

Zuletzt angesehen

Forschende

  1. Olga Batura

Publikationen

  1. Kreierung zukunftsfähiger Lernkulturen
  2. Using the three horizons approach to explore pathways towards positive futures for agricultural landscapes with rich biodiversity
  3. To Show is To Preserve – figures and demonstrations
  4. Funkprotokolle für mobile Anwendungen
  5. Auswendigkeit (oder: Toast Master´s Backen ohne Mehl)
  6. Die Alpen
  7. Participatory Governance of Science
  8. Are you sure about what you mean by ‘uncertainty’?
  9. A leverage points perspective on Arctic Indigenous food systems research
  10. Im Züchtungswahn? Gottfried Benns „Dorische Welt“
  11. Qualitätssicherung in der Lehrerbildung
  12. Magnesium permanent mold Castings optimization
  13. A livelihood analysis of resettlement outcomes: lessons for climate-induced relocations
  14. Analyzing non-linear dynamics of organic growth: evidence from small german new ventures
  15. Ross und Reiter
  16. Summary of Workshop on Fate of Pharmaceuticals in the Environment
  17. Institutional challenges for space activities in Europe
  18. Das Konzept Eigeninitiative
  19. Do We Need to Use an Accountant? The Sales Growth and Survival Benefits to Family SMEs
  20. Beyond the Looking Glass, into the Web
  21. Universalien, religionsphilosophisch
  22. Decision support in the field of online marketing - development of a data landscape
  23. Expectation, Motivation and Willingness to Prolong Working Life of German Workers
  24. The debate on technique in the Kunstwissenschaft around 1900
  25. Irrtümer bei der Interpretation des "ökologischen Fehlschlusses"
  26. Handbuch der Mythologie
  27. 'l'll tell you what the truth is'
  28. Does storytelling for sustainability work? An experiment
  29. The Lawless Vitality of Sculpture, c. 1960-80. Formalism’s Monsters, Cybernetic Breakdowns and the Joys of Deviation
  30. Interpersonal conflicts in executive training
  31. NFDI4DS Infrastructure and Services
  32. The role of media for consumers' inflation expectation formation
  33. The diffusion of sustainable family farming practices in Colombia
  34. The bicultural phenomenon
  35. Verwaltungsrecht
  36. Antibiotics in the Aquatic Environment
  37. Porträt ohne Modell
  38. Die große Flut und die Arche
  39. Imagination and imaginaries of sustainability in cultural and artistic practices
  40. Sozio-Controlling
  41. Adopters build bridges: Changing the institutional logic for more sustainable cities
  42. Can solidarity be organized "from below" in global supply chains?
  43. Detection of up to 65% of precancerous lesions of the human colon and rectum by mutation analysis of APC, K-Ras, B-Raf and CTNNB1.
  44. Re-storying the Business, Innovation and Entrepreneurial Ecosystem Concepts
  45. The more I got, the less I need? Efficacy of Internet-based guided self-help compared to online psychoeducation for major depressive disorder
  46. Sozialarbeit in der Berufsschule