1. //
  2. Start
  3. //
  4. Publikationen
  5. Careless responding detection revisited
  6. Formate
  7. //

Careless responding detection revisited: Accuracy of direct and indirect measures

Publikation: Beiträge in Zeitschriften › Zeitschriftenaufsätze › Forschung › begutachtet

Standard

Careless responding detection revisited: Accuracy of direct and indirect measures. / Goldammer, Philippe; Stöckli, Peter Lucas; Escher, Yannik Andrea et al.
in: Behavior Research Methods, Jahrgang 56, Nr. 8, 12.2024, S. 8422-8449.

Publikation: Beiträge in Zeitschriften › Zeitschriftenaufsätze › Forschung › begutachtet

Harvard

Goldammer, P, Stöckli, PL, Escher, YA, Annen, H, Jonas, K & Antonakis, J 2024, 'Careless responding detection revisited: Accuracy of direct and indirect measures', Behavior Research Methods, Jg. 56, Nr. 8, S. 8422-8449. https://doi.org/10.3758/s13428-024-02484-3

APA

Goldammer, P., Stöckli, P. L., Escher, Y. A., Annen, H., Jonas, K., & Antonakis, J. (2024). Careless responding detection revisited: Accuracy of direct and indirect measures. Behavior Research Methods, 56(8), 8422-8449. https://doi.org/10.3758/s13428-024-02484-3

Vancouver

Goldammer P, Stöckli PL, Escher YA, Annen H, Jonas K, Antonakis J. Careless responding detection revisited: Accuracy of direct and indirect measures. Behavior Research Methods. 2024 Dez;56(8):8422-8449. Epub 2024 Aug 15. doi: 10.3758/s13428-024-02484-3

Bibtex

@article{c790d1b3c6b345ab860618e6d6a6ddc2,
title = "Careless responding detection revisited: Accuracy of direct and indirect measures",
abstract = "To screen for careless responding, researchers have a choice between several direct measures (i.e., bogus items, requiring the respondent to choose a specific answer) and indirect measures (i.e., unobtrusive post hoc indices). Given the dearth of research in the area, we examined how well direct and indirect indices perform relative to each other. In five experimental studies, we investigated whether the detection rates of the measures are affected by contextual factors: severity of the careless response pattern, type of item keying, and type of item presentation. We fully controlled the information environment by experimentally inducing careless response sets under a variety of contextual conditions. In Studies 1 and 2, participants rated the personality of an actor that presented himself in a 5-min-long videotaped speech. In Studies 3, 4, and 5, participants had to rate their own personality across two measurements. With the exception of maximum longstring, intra-individual response variability, and individual contribution to model misfit, all examined indirect indices performed better than chance in most of the examined conditions. Moreover, indirect indices had detection rates as good as and, in many cases, better than the detection rates of direct measures. We therefore encourage researchers to use indirect indices, especially within-person consistency indices, instead of direct measures.",
keywords = "Bogus items, Careless responding, Careless responding detection, Indirect methods, Infrequency items, Business psychology, Psychology",
author = "Philippe Goldammer and St{\"o}ckli, {Peter Lucas} and Escher, {Yannik Andrea} and Hubert Annen and Klaus Jonas and John Antonakis",
note = "Publisher Copyright: {\textcopyright} The Author(s) 2024.",
year = "2024",
month = dec,
doi = "10.3758/s13428-024-02484-3",
language = "English",
volume = "56",
pages = "8422--8449",
journal = "Behavior Research Methods",
issn = "1554-351X",
publisher = "Springer New York LLC",
number = "8",

}

RIS

TY - JOUR

T1 - Careless responding detection revisited

T2 - Accuracy of direct and indirect measures

AU - Goldammer, Philippe

AU - Stöckli, Peter Lucas

AU - Escher, Yannik Andrea

AU - Annen, Hubert

AU - Jonas, Klaus

AU - Antonakis, John

N1 - Publisher Copyright: © The Author(s) 2024.

PY - 2024/12

Y1 - 2024/12

N2 - To screen for careless responding, researchers have a choice between several direct measures (i.e., bogus items, requiring the respondent to choose a specific answer) and indirect measures (i.e., unobtrusive post hoc indices). Given the dearth of research in the area, we examined how well direct and indirect indices perform relative to each other. In five experimental studies, we investigated whether the detection rates of the measures are affected by contextual factors: severity of the careless response pattern, type of item keying, and type of item presentation. We fully controlled the information environment by experimentally inducing careless response sets under a variety of contextual conditions. In Studies 1 and 2, participants rated the personality of an actor that presented himself in a 5-min-long videotaped speech. In Studies 3, 4, and 5, participants had to rate their own personality across two measurements. With the exception of maximum longstring, intra-individual response variability, and individual contribution to model misfit, all examined indirect indices performed better than chance in most of the examined conditions. Moreover, indirect indices had detection rates as good as and, in many cases, better than the detection rates of direct measures. We therefore encourage researchers to use indirect indices, especially within-person consistency indices, instead of direct measures.

AB - To screen for careless responding, researchers have a choice between several direct measures (i.e., bogus items, requiring the respondent to choose a specific answer) and indirect measures (i.e., unobtrusive post hoc indices). Given the dearth of research in the area, we examined how well direct and indirect indices perform relative to each other. In five experimental studies, we investigated whether the detection rates of the measures are affected by contextual factors: severity of the careless response pattern, type of item keying, and type of item presentation. We fully controlled the information environment by experimentally inducing careless response sets under a variety of contextual conditions. In Studies 1 and 2, participants rated the personality of an actor that presented himself in a 5-min-long videotaped speech. In Studies 3, 4, and 5, participants had to rate their own personality across two measurements. With the exception of maximum longstring, intra-individual response variability, and individual contribution to model misfit, all examined indirect indices performed better than chance in most of the examined conditions. Moreover, indirect indices had detection rates as good as and, in many cases, better than the detection rates of direct measures. We therefore encourage researchers to use indirect indices, especially within-person consistency indices, instead of direct measures.

KW - Bogus items

KW - Careless responding

KW - Careless responding detection

KW - Indirect methods

KW - Infrequency items

KW - Business psychology

KW - Psychology

UR - http://www.scopus.com/inward/record.url?scp=85201313915&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/6da4b518-c696-3303-ae97-95ae4fd1795a/

U2 - 10.3758/s13428-024-02484-3

DO - 10.3758/s13428-024-02484-3

M3 - Journal articles

C2 - 39147948

AN - SCOPUS:85201313915

VL - 56

SP - 8422

EP - 8449

JO - Behavior Research Methods

JF - Behavior Research Methods

SN - 1554-351X

IS - 8

ER -

In der gleichen Zeitschrift

From pre-processing to advanced dynamic modeling of pupil data

Fink, L., Simola, J., Tavano, A., Lange, E., Wallot, S. & Laeng, B., 03.2024, in: Behavior Research Methods. 56, 3, S. 1376-1412 37 S.

Publikation: Beiträge in Zeitschriften › Zeitschriftenaufsätze › Forschung › begutachtet

oREV: An item response theory-based open receptive vocabulary task for 3- to 8-year-old children

Bohn, M., Prein, J., Koch, T., Bee, R. M., Delikaya, B., Haun, D. & Gagarina, N., 03.2024, in: Behavior Research Methods. 56, 3, S. 2595-2605 11 S.

Publikation: Beiträge in Zeitschriften › Zeitschriftenaufsätze › Forschung › begutachtet

TANGO: A reliable, open-source, browser-based task to assess individual differences in gaze understanding in 3 to 5-year-old children and adults

Prein, J. C., Kalinke, S., Haun, D. B. M. & Bohn, M., 03.2024, in: Behavior Research Methods. 56, 3, S. 2469-2485 17 S.

Publikation: Beiträge in Zeitschriften › Zeitschriftenaufsätze › Forschung › begutachtet

Distinguishing state variability from trait change in longitudinal data: The role of measurement (non)invariance in latent state-trait analyses

Geiser, C., Keller, B. T., Lockhart, G., Eid, M., Cole, D. A. & Koch, T., 03.2015, in: Behavior Research Methods. 47, 1, S. 172-203 32 S.

Publikation: Beiträge in Zeitschriften › Zeitschriftenaufsätze › Forschung › begutachtet

Weitere Publikationen dieser Person(en)

Addressing climate change with behavioral science: A global intervention tournament in 63 countries

Vlasceanu, M., Doell, K. C., Bak-Coleman, J. B., Todorova, B., Berkebile-Weinberg, M. M., Grayson, S. J., Patel, Y., Goldwert, D., Pei, Y., Chakroff, A., Pronizius, E., Broek, K. L. V. D., Vlasceanu, D., Constantino, S., Morais, M. J., Schumann, P., Rathje, S., Fang, K., Aglioti, S. M., Alfano, M., Alvarado-Yepez, A. J., Andersen, A., Anseel, F., Apps, M. A. J., Asadli, C., Awuor, F. J., Azevedo, F., Basaglia, P., Bélanger, J. J., Berger, S., Bertin, P., Białek, M., Bialobrzeska, O., Blaya-Burgo, M., Bleize, D. N. M., Bø, S., Boecker, L., Boggio, P. S., Borau, S., Bos, B., Bouguettaya, A., Brauer, M., Brick, C., Brik, T., Briker, R., Brosch, T., Buchel, O., Buonauro, D., Butalia, R., Carvacho, H., Chamberlain, S. A. E., Chan, H-Y., Chow, D., Chung, D., Cian, L., Cohen-Eick, N., Contreras-Huerta, L. S., Contu, D., Cristea, V., Cutler, J., D'Ottone, S., Keersmaecker, J. D., Delcourt, S., Delouvée, S., Diel, K., Douglas, B. D., Drupp, M. A., Dubey, S., Ekmanis, J., Elbaek, C. T., Elsherif, M., Engelhard, I. M., Escher, Y. A., Etienne, T. W., Farage, L., Farias, A. R., Feuerriegel, S., Findor, A., Freira, L., Friese, M., Gains, N. P., Gallyamova, A., Geiger, S. J., Genschow, O., Gjoneska, B., Gkinopoulos, T., Goldberg, B., Goldenberg, A., Gradidge, S., Grassini, S., Gray, K., Grelle, S., Griffin, S. M., Grigoryan, L., Grigoryan, A., Grigoryev, D., Gruber, J., Guilaran, J., Hadar, B., Hahnel, U. J. J., Halperin, E., Harvey, A. J., Haugestad, C. A. P., Herman, A. M., Hershfield, H. E., Himichi, T., Hine, D. W., Hofmann, W., Howe, L., Huaman-Chulluncuy, E. T., Huang, G., Ishii, T., Ito, A., Jia, F., Jost, J. T., Jovanović, V., Jurgiel, D., Kácha, O., Kankaanpää, R., Kantorowicz, J., Kantorowicz-Reznichenko, E., Mintz, K. K., Kaya, I., Kaya, O., Khachatryan, N., Klas, A., Klein, C., Klöckner, C. A., Koppel, L., Kosachenko, A. I., Kothe, E. J., Krebs, R., Krosch, A. R., Krouwel, A. P. M., Kyrychenko, Y., Lagomarsino, M., Lamm, C., Lange, F., Cunningham, J. L., Lees, J., Leung, T. Y., Levy, N., Lockwood, P. L., Longoni, C., Ortega, A. L., Loschelder, D. D., Lu, J. G., Luo, Y., Luomba, J., Lutz, A. E., Majer, J. M., Markowitz, E., Marsh, A. A., Mascarenhas, K. L., Mbilingi, B., Mbungu, W., McHugh, C., Meijers, M. H. C., Mercier, H., Mhagama, F. L., Michalakis, K., Mikus, N., Milliron, S., Mitkidis, P., Monge-Rodríguez, F. S., Mora, Y. L., Moreau, D., Motoki, K., Moyano, M., Mus, M., Navajas, J., Nguyen, T. L., Nguyen, D. M., Nguyen, T., Niemi, L., Nijssen, S. R. R., Nilsonne, G., Nitschke, J. P., Nockur, L., Okura, R., Öner, S., Özdoğru, A. A., Palumbo, H., Panagopoulos, C., Panasiti, M. S., Pärnamets, P., Paruzel-Czachura, M., Pavlov, Y. G., Payán-Gómez, C., Pearson, A. R., Costa, L. P. D., Petrowsky, H. M., Pfattheicher, S., Pham, N. T., Ponizovskiy, V., Pretus, C., Rêgo, G. G., Reimann, R., Rhoads, S. A., Riano-Moreno, J., Richter, I., Röer, J. P., Rosa-Sullivan, J., Ross, R. M., Sabherwal, A., Saito, T., Sarrasin, O., Say, N., Schmid, K., Schmitt, M. T., Schoenegger, P., Scholz, C., Schug, M. G., Schulreich, S., Shreedhar, G., Shuman, E., Sivan, S., Sjåstad, H., Soliman, M., Soud, K., Spampatti, T., Sparkman, G., Spasovski, O., Stanley, S. K., Stern, J. A., Strahm, N., Suko, Y., Sul, S., Syropoulos, S., Taylor, N. C., Tedaldi, E., Tinghög, G., Huynh, L. D. T., Travaglino, G. A., Tsakiris, M., Tüter, İ., Tyrala, M., Uluğ, Ö. M., Urbanek, A., Valko, D., Linden, S. V. D., Schie, K. V., Stekelenburg, A. V., Vanags, E., Västfjäll, D., Vesely, S., Vintr, J., Vranka, M., Wanguche, P. O., Willer, R., Wojcik, A. D., Xu, R., Yadav, A., Zawisza, M., Zhao, X., Zhao, J., Żuk, D. & Bavel, J. J. V., 09.02.2024, in: Science Advances. 10, 6, 19 S., eadj5778.

Publikation: Beiträge in Zeitschriften › Zeitschriftenaufsätze › Forschung › begutachtet

Context matters: Why women are not worse negotiators than men

Burmester, M., Escher, Y., Oomen, D. & Petrowsky, H., 2024, in: The In-Mind. 3/2024, 49

Publikation: Beiträge in Zeitschriften › Zeitschriftenaufsätze › Forschung › begutachtet

The International Climate Psychology Collaboration: Climate change-related data collected from 63 countries

Doell, K. C., Todorova, B., Vlasceanu, M., Bak Coleman, J. B., Pronizius, E., Schumann, P., Azevedo, F., Patel, Y., Berkebile-Wineberg, M. M., Brick, C., Lange, F., Grayson, S. J., Pei, Y., Chakroff, A., van den Broek, K. L., Lamm, C., Vlasceanu, D., Constantino, S. M., Rathje, S., Goldwert, D., Fang, K., Aglioti, S. M., Alfano, M., Alvarado-Yepez, A. J., Andersen, A., Anseel, F., Apps, M. A. J., Asadli, C., Awuor, F. J., Basaglia, P., Bélanger, J. J., Berger, S., Bertin, P., Białek, M., Bialobrzeska, O., Blaya-Burgo, M., Bleize, D. N. M., Bø, S., Boecker, L., Boggio, P. S., Borau, S., Borau, S., Bos, B., Bouguettaya, A., Brauer, M., Brik, T., Briker, R., Brosch, T., Buchel, O., Buonauro, D., Butalia, R., Carvacho, H., Chamberlain, S. A. E., Chan, H. Y., Chow, D., Chung, D., Cian, L., Cohen-Eick, N., Contreras-Huerta, L. S., Contu, D., Cristea, V., Cutler, J., D'Ottone, S., De Keersmaecker, J., Delcourt, S., Delouvée, S., Diel, K., Douglas, B. D., Drupp, M. A., Dubey, S., Ekmanis, J., Elbaek, C. T., Elsherif, M., Engelhard, I. M., Escher, Y. A., Etienne, T. W., Farage, L., Farias, A. R., Feuerriegel, S., Findor, A., Freira, L., Friese, M., Gains, N. P., Gallyamova, A., Geiger, S. J., Genschow, O., Gjoneska, B., Gkinopoulos, T., Goldberg, B., Goldenberg, A., Gradidge, S., Grassini, S., Gray, K., Grelle, S., Griffin, S. M., Grigoryan, L., Grigoryan, A., Grigoryev, D., Gruber, J., Guilaran, J., Hadar, B., Hahnel, U. J. J., Halperin, E., Harvey, A. J., Haugestad, C. A. P., Herman, A. M., Hershfield, H. E., Himichi, T., Hine, D. W., Hofmann, W., Howe, L., Huaman-Chulluncuy, E. T., Huang, G., Ishii, T., Ito, A., Jia, F., Jost, J. T., Jovanović, V., Jurgiel, D., Kácha, O., Kankaanpää, R., Kantorowicz, J., Kantorowicz-Reznichenko, E., Mintz, K. K., Kaya, I., Kaya, O., Khachatryan, N., Klas, A., Klein, C., Klöckner, C. A., Koppel, L., Kosachenko, A. I., Kothe, E. J., Krebs, R., Krosch, A. R., Krouwel, A. P. M., Kyrychenko, Y., Lagomarsino, M., Cunningham, J. L., Lees, J., Leung, T. Y., Levy, N., Lockwood, P. L., Longoni, C., Ortega, A. L., Loschelder, D. D., Lu, J. G., Luo, Y., Luomba, J., Lutz, A. E., Majer, J. M., Markowitz, E., Marsh, A. A., Mascarenhas, K. L., Mbilingi, B., Mbungu, W., McHugh, C., Meijers, M. H. C., Mercier, H., Mhagama, F. L., Michalaki, K., Mikus, N., Milliron, S. G., Mitkidis, P., Monge-Rodríguez, F. S., Mora, Y. L., Morais, M. J., Moreau, D., Motoki, K., Moyano, M., Mus, M., Navajas, J., Nguyen, T. L., Nguyen, D. M., Nguyen, T., Niemi, L., Nijssen, S. R. R., Nilsonne, G., Nitschke, J. P., Nockur, L., Okura, R., Öner, S., Özdoğru, A. A., Palumbo, H., Panagopoulos, C., Panasiti, M. S., Pärnamets, P., Paruzel-Czachura, M., Pavlov, Y. G., Payán-Gómez, C., Pearson, A. R., da Costa, L. P., Petrowsky, H. M., Pfattheicher, S., Pham, N. T., Ponizovskiy, V., Pretus, C., Rêgo, G. G., Reimann, R., Rhoads, S. A., Riano-Moreno, J., Richter, I., Röer, J. P., Rosa-Sullivan, J., Ross, R. M., Sabherwal, A., Saito, T., Sarrasin, O., Say, N., Schmid, K., Schmitt, M. T., Schoenegger, P., Scholz, C., Schug, M. G., Schulreich, S., Shreedhar, G., Shuman, E., Sivan, S., Sjåstad, H., Soliman, M., Soud, K., Spampatti, T., Sparkman, G., Spasovski, O., Stanley, S. K., Stern, J. A., Strahm, N., Suko, Y., Sul, S., Syropoulos, S., Taylor, N. C., Tedaldi, E., Tinghög, G., Huynh, L. D. T., Travaglino, G. A., Tsakiris, M., Tüter, İ., Tyrala, M., Uluğ, Ö. M., Urbanek, A., Valko, D., van der Linden, S., van Schie, K., van Stekelenburg, A., Vanags, E., Västfjäll, D., Vesely, S., Vintr, J., Vranka, M., Wanguche, P. O., Willer, R., Wojcik, A. D., Xu, R., Yadav, A., Zawisza, M., Zhao, X., Zhao, J., Żuk, D. & Van Bavel, J. J., 01.10.2024, in: Scientific data. 11, 1, 17 S., 1066.

Publikation: Beiträge in Zeitschriften › Zeitschriftenaufsätze › Forschung › begutachtet

On the utility of indirect methods for detecting faking

Goldammer, P., Stöckli, P. L., Escher, Y. A., Annen, H. & Jonas, K., 10.2024, in: Educational and Psychological Measurement. 84, 5, S. 841-868 28 S.

Publikation: Beiträge in Zeitschriften › Zeitschriftenaufsätze › Forschung › begutachtet

DOI