A Meta-Analytical Multilevel Reliability Generalization of Situational Judgment Tests (SJTs)

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

During the past 20 years, Situational Judgment Tests (SJTs) have developed into a viable tool in personnel selection. Despite their growing popularity, research examining the extent of measurement error is widely lacking. Using reliability generalization, the aim of this article was twofold: (1) establish an estimate for an average coefficient alpha of SJT scores across studies and (2) examine the influence of essential SJT features and selected study variables on score reliability. To handle potential dependent observations a three-level hierarchical linear model was used. The results indicate that the reliability of SJT scores is typically rather low and below recommended levels for highstakes applications. Additionally, both SJT and study characteristics affect score reliability. Implications for practitioners and researchers are provided to guide an appropriate use of SJTs and to initiate future research.

Original languageEnglish
JournalEuropean Journal of Psychological Assessment
Volume32
Issue number3
Pages (from-to)230-240
Number of pages11
ISSN1015-5759
DOIs
Publication statusPublished - 07.2016

    Research areas

  • Psychology
  • Cronbach's alpha, Reliability generalization, Situational Judgment Test, SJT

Recently viewed

Researchers

  1. Nadine Lüpschen

Projects

  1. Graue Medien

Publications

  1. Traducianism
  2. Guided internet-based cognitive behavioral therapy for insomnia
  3. Controlling im Nachhaltigkeitsmanagement
  4. Kunstdidaktik
  5. Secret Agents
  6. Mapping giant honey bee nests in Palawan, Philippines through a transdisciplinary approach
  7. Weiterentwicklung der Unternehmensberichterstattung
  8. Fremdfinanzierung junger Unternehmen
  9. The vital role of business processes for a business model
  10. Factorial Validity of the Anxiety Questionnaire for Students (AFS)
  11. The link between supervisory board reporting and firm performance in Germany and Austria
  12. Antibiotics in the aquatic environment - A review - Part II
  13. Happy just because. A cross-cultural study on subjective wellbeing in three Indigenous societies
  14. Stingless bees use terpenes as olfactory cues to find resin sources
  15. You Are What You Eat (from)?
  16. Léger, Fernand
  17. Editorial:Computer- und Internetgebrauch bei Kindern
  18. § 25 Übergangsregelung für Tarifverträge
  19. Fundamental Theology
  20. Integrating Life Stages into Ecological Niche Models
  21. Progress of knowledge in human resources management
  22. Texte, Textsorten und Textvernetzung
  23. Making Collective Learning Coherent
  24. Google Books als Medium und Medium
  25. Strategien technischer Bildformen
  26. Organizing for innovation through accelerators: Concluding remarks
  27. A whole-institution approach towards sustainability
  28. Impulse für die Migrationsgesellschaft
  29. Ready biodegradability of trifluoromethylated phenothiazine drugs, structural elucidation of their aquatic transformation products, and identification of environmental risks studied by LC-MS( n ) and QSAR
  30. Human
  31. Supply Chain Management
  32. Article 73 CISG
  33. Science, policy and implementation gaps: An exploration of groundwater management in Hungary
  34. University students’ experience of the Beirut port explosion
  35. Magnesium alloys as implant materials-Principles of property design for Mg-RE alloys
  36. Advancing psychotherapy and evidence-based psychological interventions