Insights into the accuracy of social scientists’ forecasts of societal change

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

  • Igor Grossmann
  • Amanda Rotella
  • Cendri A. Hutcherson
  • Konstantyn Sharpinskyi
  • Michael E.W. Varnum
  • Sebastian Achter
  • Mandeep K. Dhami
  • Xinqi Evie Guo
  • Mane Kara-Yakoubian
  • David R. Mandel
  • Louis Raes
  • Louis Tay
  • Aymeric Vie
  • Lisa Wagner
  • Matus Adamkovic
  • Arash Arami
  • Patrícia Arriaga
  • Kasun Bandara
  • Gabriel Baník
  • František Bartoš
  • Ernest Baskin
  • Christoph Bergmeir
  • Michał Białek
  • Caroline K. Børsting
  • Dillon T. Browne
  • Eugene M. Caruso
  • Rong Chen
  • Bin Tzong Chie
  • William J. Chopik
  • Robert N. Collins
  • Chin Wen Cong
  • Lucian G. Conway
  • Matthew Davis
  • Martin V. Day
  • Nathan A. Dhaliwal
  • Justin D. Durham
  • Martyna Dziekan
  • Christian T. Elbaek
  • Eric Shuman
  • Marharyta Fabrykant
  • Mustafa Firat
  • Geoffrey T. Fong
  • Jeremy A. Frimer
  • Jonathan M. Gallegos
  • Simon B. Goldberg
  • Anton Gollwitzer
  • Julia Goyal
  • Lorenz Graf-Vlachy

How well can social scientists predict societal change, and what processes underlie their predictions? To answer these questions, we ran two forecasting tournaments testing the accuracy of predictions of societal change in domains commonly studied in the social sciences: ideological preferences, political polarization, life satisfaction, sentiment on social media, and gender–career and racial bias. After we provided them with historical trend data on the relevant domain, social scientists submitted pre-registered monthly forecasts for a year (Tournament 1; N = 86 teams and 359 forecasts), with an opportunity to update forecasts on the basis of new data six months later (Tournament 2; N = 120 teams and 546 forecasts). Benchmarking forecasting accuracy revealed that social scientists’ forecasts were on average no more accurate than those of simple statistical models (historical means, random walks or linear regressions) or the aggregate forecasts of a sample from the general public (N = 802). However, scientists were more accurate if they had scientific expertise in a prediction domain, were interdisciplinary, used simpler models and based predictions on prior data.

OriginalspracheEnglisch
ZeitschriftNature Human Behaviour
Jahrgang7
Ausgabenummer4
Seiten (von - bis)484-501
Anzahl der Seiten18
DOIs
PublikationsstatusErschienen - 04.2023
Extern publiziertJa

DOI

Zuletzt angesehen

Forschende

  1. Ullrich Günther

Publikationen

  1. New methods for the analysis of links between international firm activities and firm performance
  2. Shifting Competency Requirements for IT Professionals in the Digital Transformation: A Competency Transformation Process Model
  3. Who’s afraid of the articles on state responsibility
  4. Migrant struggles and moral economies of subversion
  5. The impact of corporate governance on the pillars of corporate social performance and reporting: A review of archival research and implications for future research
  6. Community assembly and biomass production in regularly and never weeded experimental grasslands
  7. Treatment or Documentation? Pareto Optimality in the Physicians’ Time Allocation
  8. Collaboration for a more sustainable agriculture – when does it work?
  9. Experimental reduction of land use increases invertebrate abundance in grasslands
  10. The Change Challenge
  11. Integrated assessment of bioelectricity technology options
  12. Effect of laser peening process parameters and sequences on residual stress profiles
  13. Controlling des Integrationsprozesses bei Mergers & Acquisitions
  14. Three Questions about Informal Regulation
  15. When mortality knocks
  16. Ästhetische Bildung der Differenz
  17. Assessment of upstream bioprocessing
  18. Herrmann Bahr - Renaissance
  19. Global Theories of Regionalism
  20. Attitudes towards computers and information technology at three universities in Germany, Belgium, and the U.S.
  21. Eigenlogik der Städte
  22. Spatial planning and territorial governance
  23. Rebound effects
  24. Inter- und Transdisziplinarität
  25. Stichwort