On the utility of indirect methods for detecting faking

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Indirect indices for faking detection in questionnaires make use of a respondent’s deviant or unlikely response pattern over the course of the questionnaire to identify them as a faker. Compared with established direct faking indices (i.e., lying and social desirability scales), indirect indices have at least two advantages: First, they cannot be detected by the test taker. Second, their usage does not require changes to the questionnaire. In the last decades, several such indirect indices have been proposed. However, at present, the researcher’s choice between different indirect faking detection indices is guided by relatively little information, especially if conceptually different indices are to be used together. Thus, we examined and compared how well indices of a representative selection of 12 conceptionally different indirect indices perform and how well they perform individually and jointly compared with an established direct faking measure or validity scale. We found that, first, the score on the agreement factor of the Likert-type item response process tree model, the proportion of desirable scale endpoint responses, and the covariance index were the best-performing indirect indices. Second, using indirect indices in combination resulted in comparable and in some cases even better detection rates than when using direct faking measures. Third, some effective indirect indices were only minimally correlated with substantive scales and could therefore be used to partial faking variance from response sets without losing substance. We, therefore, encourage researchers to use indirect indices instead of direct faking measures when they aim to detect faking in their data.
Original languageEnglish
JournalEducational and Psychological Measurement
Volume84
Issue number5
Pages (from-to)841-868
Number of pages28
ISSN0013-1644
DOIs
Publication statusPublished - 10.2024

Bibliographical note

Publisher Copyright:
© The Author(s) 2023.

Recently viewed

Publications

  1. Robust Control of Excavation Mobile Robot with Dynamic Triangulation Vision
  2. Positioning Improvement for a Laser Scanning System using cSORPD control
  3. Autonomy of Migration Despite Its Securitisation? Facing the Terms and Conditions of Biometric Rebordering
  4. Simple relay non-linear PD control for faster and high-precision motion systems with friction
  5. Pressure fault recognition and compensation with an adaptive feedforward regulator in a controlled hybrid actuator within engine applications
  6. The professional context as a predictor for response distortion in the Adaption-Innovation-Inventory – An investigation using mixture-distribution item-response theory models
  7. Phosphorus uptake from struvite is modulated by the nitrogen form applied
  8. Optimization of 3D laser scanning speed by use of combined variable step
  9. Markups and Concentration in the Context of Digitization
  10. An observer for sensorless variable valve control in camless internal combustion engines
  11. Internet-based public debate of CCS
  12. Public perceptions of CCS in context
  13. Rapid allocation of temporal attention in the Attentional Blink Paradigm
  14. Determining Lot Sizes in Production Areas
  15. Microstructure-based modeling of residual stresses in WC-12Co-sprayed coatings
  16. On the Equivalence of Transmission Problems in Nonoverlapping Domain Decomposition Methods for Quasilinear PDEs
  17. Creating a space for cooperation
  18. Trajectory tracking using MPC and a velocity observer for flat actuator systems in automotive applications
  19. Individual Scans Fusion in Virtual Knowledge Base for Navigation of Mobile Robotic Group with 3D TVS