Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Standard

Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs. / Huber, Christoph; Dreber, Anna; Huber, Jürgen et al.
in: Proceedings of the National Academy of Sciences (USA), Jahrgang 120, Nr. 23, e2215572120, 06.06.2023.

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Harvard

Huber, C, Dreber, A, Huber, J, Johannesson, M, Kirchler, M, Weitzel, U, Abellán, M, Adayeva, X, Ay, FC, Barron, K, Berry, Z, Bönte, W, Brütt, K, Bulutay, M, Campos-Mercade, P, Cardella, E, Claassen, MA, Cornelissen, G, Dawson, IGJ, Delnoij, J, Demiral, EE, Dimant, E, Doerflinger, JT, Dold, M, Emery, C, Fiala, L, Fiedler, S, Freddi, E, Fries, T, Gasiorowska, A, Glogowsky, U, M Gorny, P, Gretton, JD, Grohmann, A, Hafenbrädl, S, Handgraaf, M, Hanoch, Y, Hart, E, Hennig, M, Hudja, S, Hütter, M, Hyndman, K, Ioannidis, K, Isler, O, Jeworrek, S, Jolles, D, Juanchich, M, Kc, RP, Khadjavi, M, Kugler, T, Li, S, Lucas, B, Mak, V, Mechtel, M, Merkle, C, Meyers, EA, Mollerstrom, J, Nesterov, A, Neyse, L, Nieken, P, Nussberger, AM, Palumbo, H, Peters, K, Pirrone, A, Qin, X, Rahal, RM, Rau, H, Rincke, J, Ronzani, P, Roth, Y, Saral, AS, Schmitz, J, Schneider, F, Schram, A, Schudy, S, Schweitzer, ME, Schwieren, C, Scopelliti, I, Sirota, M, Sonnemans, J, Soraperra, I, Spantig, L, Steimanis, I, Steinmetz, J, Suetens, S, Theodoropoulou, A, Urbig, D, Vorlaufer, T, Waibel, J, Woods, D, Yakobi, O, Yilmaz, O, Zaleskiewicz, T, Zeisberger, S & Holzmeister, F 2023, 'Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs', Proceedings of the National Academy of Sciences (USA), Jg. 120, Nr. 23, e2215572120. https://doi.org/10.1073/pnas.2215572120

APA

Huber, C., Dreber, A., Huber, J., Johannesson, M., Kirchler, M., Weitzel, U., Abellán, M., Adayeva, X., Ay, F. C., Barron, K., Berry, Z., Bönte, W., Brütt, K., Bulutay, M., Campos-Mercade, P., Cardella, E., Claassen, M. A., Cornelissen, G., Dawson, I. G. J., ... Holzmeister, F. (2023). Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs. Proceedings of the National Academy of Sciences (USA), 120(23), Artikel e2215572120. https://doi.org/10.1073/pnas.2215572120

Vancouver

Huber C, Dreber A, Huber J, Johannesson M, Kirchler M, Weitzel U et al. Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs. Proceedings of the National Academy of Sciences (USA). 2023 Jun 6;120(23):e2215572120. doi: 10.1073/pnas.2215572120

Bibtex

@article{c21304a99276450ebd00a556c8c2ceeb,
title = "Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs",
abstract = "Does competition affect moral behavior? This fundamental question has been debated among leading scholars for centuries, and more recently, it has been tested in experimental studies yielding a body of rather inconclusive empirical evidence. A potential source of ambivalent empirical results on the same hypothesis is design heterogeneity-variation in true effect sizes across various reasonable experimental research protocols. To provide further evidence on whether competition affects moral behavior and to examine whether the generalizability of a single experimental study is jeopardized by design heterogeneity, we invited independent research teams to contribute experimental designs to a crowd-sourced project. In a large-scale online data collection, 18,123 experimental participants were randomly allocated to 45 randomly selected experimental designs out of 95 submitted designs. We find a small adverse effect of competition on moral behavior in a meta-analysis of the pooled data. The crowd-sourced design of our study allows for a clean identification and estimation of the variation in effect sizes above and beyond what could be expected due to sampling variance. We find substantial design heterogeneity-estimated to be about 1.6 times as large as the average standard error of effect size estimates of the 45 research designs-indicating that the informativeness and generalizability of results based on a single experimental design are limited. Drawing strong conclusions about the underlying hypotheses in the presence of substantive design heterogeneity requires moving toward much larger data collections on various experimental designs testing the same hypothesis.",
keywords = "competition, experimental design, generalizability, metascience, moral behavior, Economics",
author = "Christoph Huber and Anna Dreber and J{\"u}rgen Huber and Magnus Johannesson and Michael Kirchler and Utz Weitzel and Miguel Abell{\'a}n and Xeniya Adayeva and Ay, {Fehime Ceren} and Kai Barron and Zachariah Berry and Werner B{\"o}nte and Katharina Br{\"u}tt and Muhammed Bulutay and Pol Campos-Mercade and Eric Cardella and Claassen, {Maria Almudena} and Gert Cornelissen and Dawson, {Ian G.J.} and Joyce Delnoij and Demiral, {Elif E.} and Eugen Dimant and Doerflinger, {Johannes Theodor} and Malte Dold and C{\'e}cile Emery and Lenka Fiala and Susann Fiedler and Eleonora Freddi and Tilman Fries and Agata Gasiorowska and Ulrich Glogowsky and {M Gorny}, Paul and Gretton, {Jeremy David} and Antonia Grohmann and Sebastian Hafenbr{\"a}dl and Michel Handgraaf and Yaniv Hanoch and Einav Hart and Max Hennig and Stanton Hudja and Mandy H{\"u}tter and Kyle Hyndman and Konstantinos Ioannidis and Ozan Isler and Sabrina Jeworrek and Daniel Jolles and Marie Juanchich and Kc, {Raghabendra Pratap} and Menusch Khadjavi and Tamar Kugler and Shuwen Li and Brian Lucas and Vincent Mak and Mario Mechtel and Christoph Merkle and Meyers, {Ethan Andrew} and Johanna Mollerstrom and Alexander Nesterov and Levent Neyse and Petra Nieken and Nussberger, {Anne Marie} and Helena Palumbo and Kim Peters and Angelo Pirrone and Xiangdong Qin and Rahal, {Rima Maria} and Holger Rau and Johannes Rincke and Piero Ronzani and Yefim Roth and Saral, {Ali Seyhun} and Jan Schmitz and Florian Schneider and Arthur Schram and Simeon Schudy and Schweitzer, {Maurice E.} and Christiane Schwieren and Irene Scopelliti and Miroslav Sirota and Joep Sonnemans and Ivan Soraperra and Lisa Spantig and Ivo Steimanis and Janina Steinmetz and Sigrid Suetens and Andriana Theodoropoulou and Diemo Urbig and Tobias Vorlaufer and Joschka Waibel and Daniel Woods and Ofir Yakobi and Onurcan Yilmaz and Tomasz Zaleskiewicz and Stefan Zeisberger and Felix Holzmeister",
note = "Publisher Copyright: Copyright {\textcopyright} 2023 the Author(s).",
year = "2023",
month = jun,
day = "6",
doi = "10.1073/pnas.2215572120",
language = "English",
volume = "120",
journal = "Proceedings of the National Academy of Sciences (USA)",
issn = "0027-8424",
publisher = "National Academy of Sciences",
number = "23",

}

RIS

TY - JOUR

T1 - Competition and moral behavior

T2 - A meta-analysis of forty-five crowd-sourced experimental designs

AU - Huber, Christoph

AU - Dreber, Anna

AU - Huber, Jürgen

AU - Johannesson, Magnus

AU - Kirchler, Michael

AU - Weitzel, Utz

AU - Abellán, Miguel

AU - Adayeva, Xeniya

AU - Ay, Fehime Ceren

AU - Barron, Kai

AU - Berry, Zachariah

AU - Bönte, Werner

AU - Brütt, Katharina

AU - Bulutay, Muhammed

AU - Campos-Mercade, Pol

AU - Cardella, Eric

AU - Claassen, Maria Almudena

AU - Cornelissen, Gert

AU - Dawson, Ian G.J.

AU - Delnoij, Joyce

AU - Demiral, Elif E.

AU - Dimant, Eugen

AU - Doerflinger, Johannes Theodor

AU - Dold, Malte

AU - Emery, Cécile

AU - Fiala, Lenka

AU - Fiedler, Susann

AU - Freddi, Eleonora

AU - Fries, Tilman

AU - Gasiorowska, Agata

AU - Glogowsky, Ulrich

AU - M Gorny, Paul

AU - Gretton, Jeremy David

AU - Grohmann, Antonia

AU - Hafenbrädl, Sebastian

AU - Handgraaf, Michel

AU - Hanoch, Yaniv

AU - Hart, Einav

AU - Hennig, Max

AU - Hudja, Stanton

AU - Hütter, Mandy

AU - Hyndman, Kyle

AU - Ioannidis, Konstantinos

AU - Isler, Ozan

AU - Jeworrek, Sabrina

AU - Jolles, Daniel

AU - Juanchich, Marie

AU - Kc, Raghabendra Pratap

AU - Khadjavi, Menusch

AU - Kugler, Tamar

AU - Li, Shuwen

AU - Lucas, Brian

AU - Mak, Vincent

AU - Mechtel, Mario

AU - Merkle, Christoph

AU - Meyers, Ethan Andrew

AU - Mollerstrom, Johanna

AU - Nesterov, Alexander

AU - Neyse, Levent

AU - Nieken, Petra

AU - Nussberger, Anne Marie

AU - Palumbo, Helena

AU - Peters, Kim

AU - Pirrone, Angelo

AU - Qin, Xiangdong

AU - Rahal, Rima Maria

AU - Rau, Holger

AU - Rincke, Johannes

AU - Ronzani, Piero

AU - Roth, Yefim

AU - Saral, Ali Seyhun

AU - Schmitz, Jan

AU - Schneider, Florian

AU - Schram, Arthur

AU - Schudy, Simeon

AU - Schweitzer, Maurice E.

AU - Schwieren, Christiane

AU - Scopelliti, Irene

AU - Sirota, Miroslav

AU - Sonnemans, Joep

AU - Soraperra, Ivan

AU - Spantig, Lisa

AU - Steimanis, Ivo

AU - Steinmetz, Janina

AU - Suetens, Sigrid

AU - Theodoropoulou, Andriana

AU - Urbig, Diemo

AU - Vorlaufer, Tobias

AU - Waibel, Joschka

AU - Woods, Daniel

AU - Yakobi, Ofir

AU - Yilmaz, Onurcan

AU - Zaleskiewicz, Tomasz

AU - Zeisberger, Stefan

AU - Holzmeister, Felix

N1 - Publisher Copyright: Copyright © 2023 the Author(s).

PY - 2023/6/6

Y1 - 2023/6/6

N2 - Does competition affect moral behavior? This fundamental question has been debated among leading scholars for centuries, and more recently, it has been tested in experimental studies yielding a body of rather inconclusive empirical evidence. A potential source of ambivalent empirical results on the same hypothesis is design heterogeneity-variation in true effect sizes across various reasonable experimental research protocols. To provide further evidence on whether competition affects moral behavior and to examine whether the generalizability of a single experimental study is jeopardized by design heterogeneity, we invited independent research teams to contribute experimental designs to a crowd-sourced project. In a large-scale online data collection, 18,123 experimental participants were randomly allocated to 45 randomly selected experimental designs out of 95 submitted designs. We find a small adverse effect of competition on moral behavior in a meta-analysis of the pooled data. The crowd-sourced design of our study allows for a clean identification and estimation of the variation in effect sizes above and beyond what could be expected due to sampling variance. We find substantial design heterogeneity-estimated to be about 1.6 times as large as the average standard error of effect size estimates of the 45 research designs-indicating that the informativeness and generalizability of results based on a single experimental design are limited. Drawing strong conclusions about the underlying hypotheses in the presence of substantive design heterogeneity requires moving toward much larger data collections on various experimental designs testing the same hypothesis.

AB - Does competition affect moral behavior? This fundamental question has been debated among leading scholars for centuries, and more recently, it has been tested in experimental studies yielding a body of rather inconclusive empirical evidence. A potential source of ambivalent empirical results on the same hypothesis is design heterogeneity-variation in true effect sizes across various reasonable experimental research protocols. To provide further evidence on whether competition affects moral behavior and to examine whether the generalizability of a single experimental study is jeopardized by design heterogeneity, we invited independent research teams to contribute experimental designs to a crowd-sourced project. In a large-scale online data collection, 18,123 experimental participants were randomly allocated to 45 randomly selected experimental designs out of 95 submitted designs. We find a small adverse effect of competition on moral behavior in a meta-analysis of the pooled data. The crowd-sourced design of our study allows for a clean identification and estimation of the variation in effect sizes above and beyond what could be expected due to sampling variance. We find substantial design heterogeneity-estimated to be about 1.6 times as large as the average standard error of effect size estimates of the 45 research designs-indicating that the informativeness and generalizability of results based on a single experimental design are limited. Drawing strong conclusions about the underlying hypotheses in the presence of substantive design heterogeneity requires moving toward much larger data collections on various experimental designs testing the same hypothesis.

KW - competition

KW - experimental design

KW - generalizability

KW - metascience

KW - moral behavior

KW - Economics

UR - http://www.scopus.com/inward/record.url?scp=85160653952&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/515f6889-e7e2-3490-8d52-c31b2b1dd3d4/

U2 - 10.1073/pnas.2215572120

DO - 10.1073/pnas.2215572120

M3 - Journal articles

C2 - 37252958

AN - SCOPUS:85160653952

VL - 120

JO - Proceedings of the National Academy of Sciences (USA)

JF - Proceedings of the National Academy of Sciences (USA)

SN - 0027-8424

IS - 23

M1 - e2215572120

ER -

DOI