Enhancing careless responding detection: A norm group-based calculation approach

Activity: Talk or presentationConference PresentationsResearch

Yannik A. Escher - Speaker

Philippe Goldammer - Coauthor

Peter L. Stöckli - Coauthor

Hubert Annen - Coauthor

Anna Luca Heimann - Coauthor

Undetected careless responding in survey data poses a significant threat to the validity of psychological research and questionnaire-based decisions. Even small portions of careless responses can bias reliability estimates, factor loadings, or item means, ultimately distorting findings from widely used Likert scale-based questionnaires. Across two pre-registered studies, this research investigates if and under what conditions a new set of norm group-based indices outperforms promising conventional methods in detecting careless respondents (i.e., Mahalanobis Distance and person-total/personal-biserial correlation coefficient). In Study 1, we will simulate n = 500 observations across k = 100 replications and m = 72 conditions, resulting in a total of 7,200 samples. Additionally, in Study 2, we will conduct a re-analysis of real incentivized data (N = 481), using our proposed implicit norm group-based indices. Data collection for both studies is ongoing, and results will be presented at AOWI 2025. We will discuss potential limitations, such as parameter constraints in Study 1 (e.g., careless patterns, norm group sizes) or confounding factors in Study 2 (e.g., survey length, the presence of genuinely careless respondents). The present study will provide practical guidance for improving the detection of careless responding in survey-based research and offers a novel approach for calculating implicit careless responding indices. This work will contribute to more reliable survey-based assessments in organizational psychology and hopefully enhance the credibility of psychological findings derived from questionnaires and surveys.
12.09.2025

Event

14. Fachgruppentagung der Arbeits-, Organisations- und Wirtschaftspsychologie und Ingenieurspsychologie 2025

09.09.2512.09.25

Lüneburg, Germany

Event: Conference

Recently viewed

Activities

  1. Universität California, Berkeley
  2. Building Collective Institutional Infrastructures for Decent Platform Work: The Development of a Crowdwork Agreement in Germany
  3. Parks of the Future – Protected Areas in Europe Challenging Issues of Societal Transformation
  4. Training of Entrepreneurs
  5. Künstliche Intelligenz und Fremdsprachenlernen (Ludwig-Maximilians-Universität München)
  6. Learning and Acting for a Sustainable Future
  7. mathematica didactica (Zeitschrift)
  8. Förderprogramm „Gesellschaftliche Verantwortung im Mittelstand“
  9. 2nd PERL International Conference 2012
  10. Regional monitoring and modeling of the effects of vegetation restoration on soil erosion’
  11. Assessing pre-service teachers‘ perceptions of peer feedback content relating to self-efficacy [Conference canceled}
  12. 'Teaching as a journey, not a destination.’ Examining the Inclusive Mindsets, Attitudes and Reflective Competence of Pre-Service and Experienced EFL Teachers in Germany
  13. Fakultät Bildung (Organisation)
  14. Zur Idee einer zweiten kopernikanischen Wende
  15. Division of Occupational Psychology Annual Conference - DOP 2013
  16. Leverage points for sustainability transformation in the Water-Energy-Food Nexus – Institutional perspectives
  17. Die Funktion der Nachhaltigkeit
  18. Mixed Methods International Research Association (Externe Organisation)
  19. Nomos Verlagsgesellschaft (Verlag)
  20. Moving beyond unlearning unsustainable consumption. Salutogenetic perspectives on education for sustainable consumption
  21. Berufung in den Beirat der Studie zur Entwicklung der Ganztagsschule (StEG)