Enhancing careless responding detection: A norm group-based calculation approach

Activity: Talk or presentationConference PresentationsResearch

Yannik A. Escher - Speaker

Philippe Goldammer - Coauthor

Peter L. Stöckli - Coauthor

Hubert Annen - Coauthor

Anna Luca Heimann - Coauthor

Undetected careless responding in survey data poses a significant threat to the validity of psychological research and questionnaire-based decisions. Even small portions of careless responses can bias reliability estimates, factor loadings, or item means, ultimately distorting findings from widely used Likert scale-based questionnaires. Across two pre-registered studies, this research investigates if and under what conditions a new set of norm group-based indices outperforms promising conventional methods in detecting careless respondents (i.e., Mahalanobis Distance and person-total/personal-biserial correlation coefficient). In Study 1, we will simulate n = 500 observations across k = 100 replications and m = 72 conditions, resulting in a total of 7,200 samples. Additionally, in Study 2, we will conduct a re-analysis of real incentivized data (N = 481), using our proposed implicit norm group-based indices. Data collection for both studies is ongoing, and results will be presented at AOWI 2025. We will discuss potential limitations, such as parameter constraints in Study 1 (e.g., careless patterns, norm group sizes) or confounding factors in Study 2 (e.g., survey length, the presence of genuinely careless respondents). The present study will provide practical guidance for improving the detection of careless responding in survey-based research and offers a novel approach for calculating implicit careless responding indices. This work will contribute to more reliable survey-based assessments in organizational psychology and hopefully enhance the credibility of psychological findings derived from questionnaires and surveys.
12.09.2025

Event

14. Fachgruppentagung der Arbeits-, Organisations- und Wirtschaftspsychologie und Ingenieurspsychologie - AOWI 2025: Arbeitswelten im Wandel: Kooperation zwischen Mensch und Technik

09.09.2512.09.25

Lüneburg, Lower Saxony, Germany

Event: Conference

Recently viewed

Publications

  1. Dynamic environment modelling and prediction for autonomous systems
  2. Emergency detection based on probabilistic modeling in AAL-environments
  3. Functional Richness and Relative Resilience of Bird Communities in Regions with Different Land Use Intensities
  4. Top-down contingent attentional capture during feed-forward visual processing
  5. A general structural property in wavelet packets for detecting oscillation and noise components in signal analysis
  6. The effects of different on-line adaptive response time limits on speed and amount of learning in computer assisted instruction and intelligent tutoring
  7. Eighth Workshop on Mining and Learning with Graphs
  8. A longitudinal multilevel CFA-MTMM model for interchangeable and structurally different methods
  9. Effectiveness of a Web-Based Cognitive Behavioural Intervention for Subthreshold Depression
  10. Optimized neural networks for modeling of loudspeaker directivity diagrams
  11. Input-Output Linearization of a Thermoelectric Cooler for an Ice Clamping System Using a Dual Extended Kalman Filter
  12. Using conditional inference trees and random forests to predict the bioaccumulation potential of organic chemicals
  13. Primary Side Circuit Design of a Multi-coil Inductive System for Powering Wireless Sensors
  14. On New Forms of Science Communication and Communication in Science
  15. Intellectual Property Issues in Space Contracts
  16. Visualization of the Plasma Frequency by means of a Particle Simulation using a Normalized Periodic Model
  17. A Playful Approach to Interactive Media in the Foreign Language Classroom
  18. Children's use of spatial skills in solving two map-reading tasks in real space.
  19. Complex problem solving and intelligence
  20. Solving mathematical problems with dynamical sketches
  21. The professional context as a predictor for response distortion in the Adaption-Innovation-Inventory – An investigation using mixture-distribution item-response theory models
  22. Promising practices for dealing with complexity in research for development
  23. Concepts
  24. Proceedings of TextGraphs-17: Graph-based Methods for Natural Language Processing
  25. Survey on challenges of Question Answering in the Semantic Web
  26. Introduction: The representative turn in EU studies
  27. Moving Towards Measuring Multifunctionality in Ecosystems: FieldScreen – A Mobile Positioning System for Non-Invasive Measurement of Plant Traits in Field Experiments
  28. A MODEL FOR QUANTIFICATION OF SOFTWARE COMPLEXITY
  29. A simple nonlinear PD control for faster and high-precision positioning of servomechanisms with actuator saturation
  30. PI and Fuzzy Controllers for Non-Linear Systems
  31. Understanding the socio-technical aspects of low-code adoption for software development
  32. Intraspecific trait variation patterns along a precipitation gradient in Mongolian rangelands
  33. Life satisfaction in Germany after reunification: Additional insights on the pattern of convergence