On the utility of indirect methods for detecting faking

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Indirect indices for faking detection in questionnaires make use of a respondent’s deviant or unlikely response pattern over the course of the questionnaire to identify them as a faker. Compared with established direct faking indices (i.e., lying and social desirability scales), indirect indices have at least two advantages: First, they cannot be detected by the test taker. Second, their usage does not require changes to the questionnaire. In the last decades, several such indirect indices have been proposed. However, at present, the researcher’s choice between different indirect faking detection indices is guided by relatively little information, especially if conceptually different indices are to be used together. Thus, we examined and compared how well indices of a representative selection of 12 conceptionally different indirect indices perform and how well they perform individually and jointly compared with an established direct faking measure or validity scale. We found that, first, the score on the agreement factor of the Likert-type item response process tree model, the proportion of desirable scale endpoint responses, and the covariance index were the best-performing indirect indices. Second, using indirect indices in combination resulted in comparable and in some cases even better detection rates than when using direct faking measures. Third, some effective indirect indices were only minimally correlated with substantive scales and could therefore be used to partial faking variance from response sets without losing substance. We, therefore, encourage researchers to use indirect indices instead of direct faking measures when they aim to detect faking in their data.
Original languageEnglish
JournalEducational and Psychological Measurement
Volume84
Issue number5
Pages (from-to)841-868
Number of pages28
ISSN0013-1644
DOIs
Publication statusPublished - 10.2024

Bibliographical note

Publisher Copyright:
© The Author(s) 2023.

Recently viewed

Publications

  1. Avoiding Algorithm Error in Computer-Aided Text Analyses
  2. Risk preferences under heterogeneous environmental risk
  3. Begabungsdiagnostik mit dem Grundintelligenztest (CFT 20-R)
  4. Homogenization modeling of thin-layer-type microstructures
  5. A Kalman estimator for detecting repetitive disturbances
  6. The liquidity regulation and savings banks' liquid assets
  7. Proxy Indicators for the Quality of Open-domain Dialogues
  8. Communities of ground-living spiders in deciduous forests
  9. Freistellung von Betriebsräten - eine Beschäftigungsbremse?
  10. Influence of cerium on stress corrosion cracking in AZ91D
  11. The German Bank Restructuring Act: An Economic Perspective
  12. Dynamic Lot Size Optimization with Reinforcement Learning
  13. Using Complexity Metrics to Assess Silent Reading Fluency
  14. School Leader Trust and Collective Teacher Innovativeness
  15. Meta-analytic cointegrating rank tests for dependent panels
  16. Einflüsse der Land- und Wassernutzung auf das Niedrigwasser
  17. Productivity premia for many modes of internationalization.
  18. Study on Mg–Si–Sr ternary alloys for biomedical applications
  19. Corrosion behaviour of electropolished magnesium materials
  20. Das Individuum und die Peers - eine strukturelle Perspektive
  21. Perfect anti-windup in output tracking scheme with preaction
  22. Dynamics of Supply Chains Under Mixed Production Strategies
  23. The Cox ring of the space of complete rank two collineations
  24. Does more respect from leaders postpone the desire to retire?
  25. Propagation of particles injected from interplanetary shocks
  26. Does Internet-based guided self-help for depression cause harm?
  27. Gesellschaftliche Naturverhältnisse zwischen Krise und Vision
  28. Wo lernen Kinder mit sonderpädagogischem Förderbedarf besser?
  29. Product diversification and stability of employment and sales
  30. Do learner characteristics moderate the seductive-details-effect?