TY - JOUR

T1 - Evaluating the construct validity of Objective Personality Tests using a multitrait-multimethod-Multioccasion-(MTMM-MO)-approach

AU - Koch, Tobias

AU - Ortner, T. M.

AU - Eid, M.

AU - Caspers, J.

AU - Schmitt, M.

N1 - We would like to express our great appreciation to MarkusMeindl, Juliane Caspers, Eva Ebenführer, Tobias Stadler,Elisabeth Becker, Benjamin Augustin, Nicole Mathwig,Franziska Vogel, and Lisa Grünberger for their supportand help in the project. The project was founded by theGerman Research Foundation (DFG, Project NumberOR 238 \ 3-1).

PY - 2014

Y1 - 2014

N2 - Although Objective Personality Tests (OPTs) have a long history in psychology and the field of psychological assessment, their validity, and reliability have not yet been sufficiently studied. In this study, we examined the convergent and discriminant validity of objective (personality) tests, Implicit Association Tests (IATs), and self-report measures for the assessment of conscientiousness and intelligence. Moreover, the convergent and discriminant validity of these measures was assessed on the trait (stable) and occasion specific (momentary) level by using the multimethod latent state-trait (MM-LST) model proposed by Courvoisier, Nussbeck, Eid, and Cole (2008) which allows for the decomposition of different sources of variance. Data from 367 students assessed on three different measurement occasions was incorporated. Results indicate generally low convergence of OPTs with data gained by other approaches. Additional analyses revealed that the OPTs used assess stable rather than momentary components of the constructs. Reliabilities of different tests ranged from.54 to.95. Furthermore, a substantial amount of trait method specificity revealed that different methods assess trait components that are not shared between OPTs and other measures. Data on the criterion validity of the objective conscientiousness test revealed that it is related to the punctuality of test takers in the laboratory.

AB - Although Objective Personality Tests (OPTs) have a long history in psychology and the field of psychological assessment, their validity, and reliability have not yet been sufficiently studied. In this study, we examined the convergent and discriminant validity of objective (personality) tests, Implicit Association Tests (IATs), and self-report measures for the assessment of conscientiousness and intelligence. Moreover, the convergent and discriminant validity of these measures was assessed on the trait (stable) and occasion specific (momentary) level by using the multimethod latent state-trait (MM-LST) model proposed by Courvoisier, Nussbeck, Eid, and Cole (2008) which allows for the decomposition of different sources of variance. Data from 367 students assessed on three different measurement occasions was incorporated. Results indicate generally low convergence of OPTs with data gained by other approaches. Additional analyses revealed that the OPTs used assess stable rather than momentary components of the constructs. Reliabilities of different tests ranged from.54 to.95. Furthermore, a substantial amount of trait method specificity revealed that different methods assess trait components that are not shared between OPTs and other measures. Data on the criterion validity of the objective conscientiousness test revealed that it is related to the punctuality of test takers in the laboratory.

KW - Sociology

KW - OPT

KW - Objective test, Objective Personality Test

KW - MTMM

KW - Intelligence

KW - conscientiousness

UR - http://www.scopus.com/inward/record.url?scp=84932180880&partnerID=8YFLogxK

U2 - 10.1027/1015-5759/a000212

DO - 10.1027/1015-5759/a000212

M3 - Journal articles

AN - SCOPUS:84932180880

VL - 30

SP - 208

EP - 230

JO - European Journal of Psychological Assessment

JF - European Journal of Psychological Assessment

SN - 1015-5759

IS - 3

ER -