Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Christoph Huber
  • Anna Dreber
  • Jürgen Huber
  • Magnus Johannesson
  • Michael Kirchler
  • Utz Weitzel
  • Xeniya Adayeva
  • Fehime Ceren Ay
  • Kai Barron
  • Zachariah Berry
  • Werner Bönte
  • Katharina Brütt
  • Muhammed Bulutay
  • Pol Campos-Mercade
  • Eric Cardella
  • Maria Almudena Claassen
  • Gert Cornelissen
  • Ian G.J. Dawson
  • Joyce Delnoij
  • Elif E. Demiral
  • Eugen Dimant
  • Johannes Theodor Doerflinger
  • Malte Dold
  • Cécile Emery
  • Lenka Fiala
  • Susann Fiedler
  • Eleonora Freddi
  • Tilman Fries
  • Agata Gasiorowska
  • Ulrich Glogowsky
  • Paul M Gorny
  • Jeremy David Gretton
  • Antonia Grohmann
  • Sebastian Hafenbrädl
  • Michel Handgraaf
  • Yaniv Hanoch
  • Einav Hart
  • Max Hennig
  • Stanton Hudja
  • Mandy Hütter
  • Kyle Hyndman
  • Konstantinos Ioannidis
  • Ozan Isler
  • Sabrina Jeworrek
  • Daniel Jolles
  • Marie Juanchich
  • Raghabendra Pratap Kc
  • Menusch Khadjavi
  • Tamar Kugler
  • Shuwen Li
  • Brian Lucas
  • Vincent Mak
  • Christoph Merkle
  • Ethan Andrew Meyers
  • Johanna Mollerstrom
  • Alexander Nesterov
  • Levent Neyse
  • Petra Nieken
  • Anne Marie Nussberger
  • Helena Palumbo
  • Kim Peters
  • Angelo Pirrone
  • Xiangdong Qin
  • Rima Maria Rahal
  • Holger Rau
  • Johannes Rincke
  • Piero Ronzani
  • Yefim Roth
  • Ali Seyhun Saral
  • Jan Schmitz
  • Florian Schneider
  • Arthur Schram
  • Simeon Schudy
  • Maurice E. Schweitzer
  • Christiane Schwieren
  • Irene Scopelliti
  • Miroslav Sirota
  • Joep Sonnemans
  • Ivan Soraperra
  • Lisa Spantig
  • Ivo Steimanis
  • Janina Steinmetz
  • Sigrid Suetens
  • Andriana Theodoropoulou
  • Diemo Urbig
  • Tobias Vorlaufer
  • Joschka Waibel
  • Daniel Woods
  • Ofir Yakobi
  • Onurcan Yilmaz
  • Tomasz Zaleskiewicz
  • Stefan Zeisberger
  • Felix Holzmeister

Does competition affect moral behavior? This fundamental question has been debated among leading scholars for centuries, and more recently, it has been tested in experimental studies yielding a body of rather inconclusive empirical evidence. A potential source of ambivalent empirical results on the same hypothesis is design heterogeneity-variation in true effect sizes across various reasonable experimental research protocols. To provide further evidence on whether competition affects moral behavior and to examine whether the generalizability of a single experimental study is jeopardized by design heterogeneity, we invited independent research teams to contribute experimental designs to a crowd-sourced project. In a large-scale online data collection, 18,123 experimental participants were randomly allocated to 45 randomly selected experimental designs out of 95 submitted designs. We find a small adverse effect of competition on moral behavior in a meta-analysis of the pooled data. The crowd-sourced design of our study allows for a clean identification and estimation of the variation in effect sizes above and beyond what could be expected due to sampling variance. We find substantial design heterogeneity-estimated to be about 1.6 times as large as the average standard error of effect size estimates of the 45 research designs-indicating that the informativeness and generalizability of results based on a single experimental design are limited. Drawing strong conclusions about the underlying hypotheses in the presence of substantive design heterogeneity requires moving toward much larger data collections on various experimental designs testing the same hypothesis.

Original languageEnglish
Article numbere2215572120
JournalProceedings of the National Academy of Sciences (USA)
Volume120
Issue number23
Number of pages26
ISSN0027-8424
DOIs
Publication statusPublished - 06.06.2023

Bibliographical note

Publisher Copyright:
Copyright © 2023 the Author(s).

    Research areas

  • competition, experimental design, generalizability, metascience, moral behavior
  • Economics

DOI

Recently viewed

Publications

  1. Cost-Effectiveness and Cost-Benefit Analysis of Maintenance Measures for Open Landscapes
  2. Observer Strategies for Virtual Sensing of Embroidered Metal-Polymer Heater Structure
  3. Monoculture and mixture-planting of non-native Douglas fir alters species composition, but promotes the diversity of ground beetles in a temperate forest system
  4. Effect of calcium addition on the hot working behavior of as-cast AZ31 magnesium alloy
  5. Exports, foreign direct investment, and productivity
  6. Impact of an acceptance facilitating intervention on diabetes patients' acceptance of Internet-based interventions for depression
  7. Drawing blanks and winning
  8. The Influence Of Product Reuse On Production Planning and Control
  9. Multifractality of overlapping non-uniform self-similar measures
  10. Grain refinement of Mg-Al alloys by carbon inoculation
  11. Learning the hard way
  12. On the Problems of Honorary Work in German Sports Clubs – A Qualitative-Dominated Crossover Mixed Methods Study
  13. Development of recyclable Mg-based alloys
  14. Creep and hot working behavior of a new magnesium alloy Mg-3Sn-2Ca
  15. Meta-analytic cointegrating rank tests for dependent panels
  16. Measurement approaches for inigrated reporting adoption and quality
  17. Ablauforganisation in Arztpraxen
  18. Investigations on microstructure and properties of Mg-Sn-Ca alloys with 3% Al additions
  19. Evaluating a web-based PPGIS for the rehabilitation of urban riparian corridors
  20. Multiscale performance of landscape metrics as indicators of species richness of plants, insects and vertebrates
  21. Mechanical behaviors of extruded Mg alloys with high Gd and Nd content
  22. Policy schemes, operational strategies and system integration of residential co-generation fuel cells.
  23. Is there an excess of significant findings in published studies of psychotherapy for depression?
  24. Organic farming affects the biological control of hemipteran pests and yields in spring barley independent of landscape complexity
  25. Assessing Trust by Disclosure in Online Social Networks
  26. Product diversification and stability of employment and sales
  27. Dynamische Modellierung der Sorption von Substanzen in einem hydrologischen Einzugsgebietsmodell anhand des Beispiels Phosphor
  28. Macroeconomic shocks and banks’ foreign assets
  29. Improving compliance with COVID-19 guidance
  30. Predicting expatriate job performance
  31. Alcohol intake can reduce gambling behavior
  32. Statistical Learning and Inference Is Impaired in the Nonclinical Continuum of Psychosis
  33. Schulbezogenes mathematisches Vorwissen von Bewerber*innen auf ein Mathematik-Lehramtsstudium
  34. Plastics in our ocean as transdisciplinary challenge
  35. Investigation On The Influence Of Remanufacturing On Production Planning And Control – A Systematic Literature Review
  36. Stock price reactions to climate science information from the Intergovernmental Panel on Climate Change
  37. Effects of elevated atmospheric CO2 concentrations on barley, sugar beet and wheat in a rotation
  38. Toward “hardened” accountability?
  39. New evidence for vegetation development and timing of Upper Middle Pleistocene interglacials in Northern Germany and tentative correlations
  40. Intermetallic phase characteristics in the Mg–Nd–Zn system
  41. Does Internet-based guided self-help for depression cause harm?
  42. Print exposure across the reading life span
  43. Reaching for the (Product) Stars
  44. Influence of cerium on stress corrosion cracking in AZ91D
  45. Elution of Monomers from Two Conventional Dental Composite Materials
  46. Effects of introspective vs. extraspective instruction in scaling of hedonic properties of flavouring ingredients by Chinese and German subjects