On the utility of indirect methods for detecting faking

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Indirect indices for faking detection in questionnaires make use of a respondent’s deviant or unlikely response pattern over the course of the questionnaire to identify them as a faker. Compared with established direct faking indices (i.e., lying and social desirability scales), indirect indices have at least two advantages: First, they cannot be detected by the test taker. Second, their usage does not require changes to the questionnaire. In the last decades, several such indirect indices have been proposed. However, at present, the researcher’s choice between different indirect faking detection indices is guided by relatively little information, especially if conceptually different indices are to be used together. Thus, we examined and compared how well indices of a representative selection of 12 conceptionally different indirect indices perform and how well they perform individually and jointly compared with an established direct faking measure or validity scale. We found that, first, the score on the agreement factor of the Likert-type item response process tree model, the proportion of desirable scale endpoint responses, and the covariance index were the best-performing indirect indices. Second, using indirect indices in combination resulted in comparable and in some cases even better detection rates than when using direct faking measures. Third, some effective indirect indices were only minimally correlated with substantive scales and could therefore be used to partial faking variance from response sets without losing substance. We, therefore, encourage researchers to use indirect indices instead of direct faking measures when they aim to detect faking in their data.
Original languageEnglish
JournalEducational and Psychological Measurement
Volume84
Issue number5
Pages (from-to)841-868
Number of pages28
ISSN0013-1644
DOIs
Publication statusPublished - 10.2024

Bibliographical note

Publisher Copyright:
© The Author(s) 2023.

Recently viewed

Publications

  1. On the origin of passive rotation in rotational joints, and how to calculate it
  2. Homogenization methods for multi-phase elastic composites with non-elliptical reinforcements
  3. Mining Implications From Data
  4. Early Detection of Faillure in Conveyor Chain Systems by Wireless Sensor Node
  5. Trait-based approaches to analyze links between the drivers of change and ecosystem services
  6. Design, Modeling and Control of an Over-actuated Hexacopter Tilt-Rotor
  7. Robust Control of Excavation Mobile Robot with Dynamic Triangulation Vision
  8. Optimal dynamic scale and structure of a multi-pollution economy
  9. An error management perspective on audit quality
  10. A high-resolution approach for the spatiotemporal analysis of forest canopy space using terrestrial laser scanning data
  11. Obstacle Coordinates Transformation from TVS Body-Frame to AGV Navigation-Frame
  12. Impulsive Feedback Linearization for Decoupling of a Constant Disturbance with Low Relative Degree to Control Maglev Systems
  13. A Sliding Mode Control with a Bang-Bang Observer for Detection of Particle Pollution
  14. Global Finite-Time Stabilization of Planar Linear Systems With Actuator Saturation
  15. A Lyapunov based PI controller with an anti-windup scheme for a purification process of potable water
  16. The Impact of AGVs and Priority Rules in a Real Production Setup – A Simulation Study
  17. Performance of process-based models for simulation of grain N in crop rotations across Europe
  18. A Control of an Electromagnetic Actuator Using Model Predictive Control
  19. Passive Rotation Compensation in Parallel Kinematics Using Quaternions
  20. Educational reconstruction as model for the theory-based design of student-centered learning environments in electrical engineering courses
  21. An isomorphism between polynomial eigenfunctions of the transfer operator and the Eichler cohomology for modular groups
  22. A geometric approach for the design and control of an electromagnetic actuator to optimize its dynamic performance
  23. Machine vision system errors for unmanned aerial vehicle navigation
  24. Modernizing persistence–bioaccumulation–toxicity (PBT) assessment with high throughput animal-free methods
  25. Factor structure and measurement invariance of the Students’ Self-report Checklist of Social and Learning Behaviour (SSL)
  26. A Structure and Content Prompt-based Method for Knowledge Graph Question Answering over Scholarly Data
  27. Simple relay non-linear PD control for faster and high-precision motion systems with friction
  28. Controlling a Bank Model Economy by Using an Adaptive Model Predictive Control with Help of an Extended Kalman Filter
  29. Reading Comprehension as Embodied Action: Exploratory Findings on Nonlinear Eye Movement Dynamics and Comprehension of Scientific Texts
  30. WHICH ESTIMATION SITUATIONS ARE RELEVANT FOR A VALID ASSESSMENT OF MEASUREMENT ESTIMATION SKILLS
  31. Individual Scans Fusion in Virtual Knowledge Base for Navigation of Mobile Robotic Group with 3D TVS
  32. DISKNET – A Platform for the Systematic Accumulation of Knowledge in IS Research
  33. Image compression based on periodic principal components
  34. On the computation of the warping function and the torsional properties of thin-walled crosssections of prismatic beams
  35. Within-individual leaf trait variation increases with phenotypic integration in a subtropical tree diversity experiment
  36. Proxy Indicators for the Quality of Open-domain Dialogues
  37. A Comparative Study for Fisheye Image Classification
  38. Functional Richness and Relative Resilience of Bird Communities in Regions with Different Land Use Intensities
  39. Pressure fault recognition and compensation with an adaptive feedforward regulator in a controlled hybrid actuator within engine applications
  40. Masked Autoencoder Pretraining for Event Classification in Elite Soccer
  41. A longitudinal multilevel CFA-MTMM model for interchangeable and structurally different methods
  42. Input-Output Linearization of a Thermoelectric Cooler for an Ice Clamping System Using a Dual Extended Kalman Filter
  43. Control oriented modeling of DCDC converters
  44. Analytic reproducibility in articles receiving open data badges at the journal Psychological Science
  45. Linear free vibrations with uncertain initial conditions
  46. Material flow analysis between dynamic modelling and life cycle assessment
  47. An Equation with many Variables