Careless responding detection revisited: Accuracy of direct and indirect measures

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

To screen for careless responding, researchers have a choice between several direct measures (i.e., bogus items, requiring the respondent to choose a specific answer) and indirect measures (i.e., unobtrusive post hoc indices). Given the dearth of research in the area, we examined how well direct and indirect indices perform relative to each other. In five experimental studies, we investigated whether the detection rates of the measures are affected by contextual factors: severity of the careless response pattern, type of item keying, and type of item presentation. We fully controlled the information environment by experimentally inducing careless response sets under a variety of contextual conditions. In Studies 1 and 2, participants rated the personality of an actor that presented himself in a 5-min-long videotaped speech. In Studies 3, 4, and 5, participants had to rate their own personality across two measurements. With the exception of maximum longstring, intra-individual response variability, and individual contribution to model misfit, all examined indirect indices performed better than chance in most of the examined conditions. Moreover, indirect indices had detection rates as good as and, in many cases, better than the detection rates of direct measures. We therefore encourage researchers to use indirect indices, especially within-person consistency indices, instead of direct measures.

OriginalspracheEnglisch
ZeitschriftBehavior Research Methods
Jahrgang56
Ausgabenummer8
Seiten (von - bis)8422-8449
Anzahl der Seiten28
ISSN1554-351X
DOIs
PublikationsstatusErschienen - 12.2024

Bibliographische Notiz

Publisher Copyright:
© The Author(s) 2024.

DOI

Zuletzt angesehen

Publikationen

  1. No-Code Platforms in Startups: Explaining Decisions for Adoption and Abandonment
  2. Essays on Network Regulation
  3. Corporate social responsibility performance, reporting and generalized methods of moments (GMM)
  4. Insight into layer formation during friction surfacing
  5. Perceptions of science, science communication, and climate change attitudes in 68 countries - the TISP dataset
  6. Temperature changes using excimer laser irradiation in a cochlear model
  7. An Introduction to the Inverted/Flipped Classroom Model in Education and Advanced Training in Medicine and in the Healthcare Professions
  8. Long-term retrospective analysis of the societal metabolism of cobalt in the European Union
  9. Gesellige Anerkennung oder Kampf um Anerkennung?
  10. Transcending the Locality of Grassroots Initiatives
  11. Dynamische Mathematik
  12. Notation
  13. Automatic Imitation
  14. Differences in the earnings distribution of self- and dependent employed German men
  15. German and Chinese perspectives on innovative teaching and classroom processes
  16. Contributing to sustainable development pathways in the South Pacific through transdisciplinary research
  17. Toward a pluralistic conservation science
  18. Rhetorik-Schulprojekte mit Lehramtsstudierenden
  19. Spatial variation in human disturbances and their effects on forest structure and biodiversity across an Afromontane forest
  20. Recognizing Guarantees and Assurances of Non-Repetition
  21. Plastics in our ocean as transdisciplinary challenge
  22. Leverage points for addressing marine and coastal pollution
  23. Nonlinear recurrence analysis of piezo sensor placement for unmanned aerial vehicle motor failure diagnosis
  24. The influence of landscape change on multiple dimensions of human–nature connectedness