Insights into the accuracy of social scientists’ forecasts of societal change

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

  • Igor Grossmann
  • Amanda Rotella
  • Cendri A. Hutcherson
  • Konstantyn Sharpinskyi
  • Michael E.W. Varnum
  • Sebastian Achter
  • Mandeep K. Dhami
  • Xinqi Evie Guo
  • Mane Kara-Yakoubian
  • David R. Mandel
  • Louis Raes
  • Louis Tay
  • Aymeric Vie
  • Lisa Wagner
  • Matus Adamkovic
  • Arash Arami
  • Patrícia Arriaga
  • Kasun Bandara
  • Gabriel Baník
  • František Bartoš
  • Ernest Baskin
  • Christoph Bergmeir
  • Michał Białek
  • Caroline K. Børsting
  • Dillon T. Browne
  • Eugene M. Caruso
  • Rong Chen
  • Bin Tzong Chie
  • William J. Chopik
  • Robert N. Collins
  • Chin Wen Cong
  • Lucian G. Conway
  • Matthew Davis
  • Martin V. Day
  • Nathan A. Dhaliwal
  • Justin D. Durham
  • Martyna Dziekan
  • Christian T. Elbaek
  • Eric Shuman
  • Marharyta Fabrykant
  • Mustafa Firat
  • Geoffrey T. Fong
  • Jeremy A. Frimer
  • Jonathan M. Gallegos
  • Simon B. Goldberg
  • Anton Gollwitzer
  • Julia Goyal
  • Lorenz Graf-Vlachy

How well can social scientists predict societal change, and what processes underlie their predictions? To answer these questions, we ran two forecasting tournaments testing the accuracy of predictions of societal change in domains commonly studied in the social sciences: ideological preferences, political polarization, life satisfaction, sentiment on social media, and gender–career and racial bias. After we provided them with historical trend data on the relevant domain, social scientists submitted pre-registered monthly forecasts for a year (Tournament 1; N = 86 teams and 359 forecasts), with an opportunity to update forecasts on the basis of new data six months later (Tournament 2; N = 120 teams and 546 forecasts). Benchmarking forecasting accuracy revealed that social scientists’ forecasts were on average no more accurate than those of simple statistical models (historical means, random walks or linear regressions) or the aggregate forecasts of a sample from the general public (N = 802). However, scientists were more accurate if they had scientific expertise in a prediction domain, were interdisciplinary, used simpler models and based predictions on prior data.

OriginalspracheEnglisch
ZeitschriftNature Human Behaviour
Jahrgang7
Ausgabenummer4
Seiten (von - bis)484-501
Anzahl der Seiten18
DOIs
PublikationsstatusErschienen - 04.2023
Extern publiziertJa

DOI

Zuletzt angesehen

Forschende

  1. Anke Bramesfeld

Publikationen

  1. The effects of pre-intervention mindset induction on a brief intervention to increase risk perception and reduce alcohol use among university students
  2. Nachwuchsförderung in Drittmittelprojekten - "untiteled" oder "Writer"?
  3. Article 21 Formal Validity
  4. An archetype analysis of sustainability innovations in Biosphere Reserves: Insights for assessing transformative potential
  5. Resolving Incompleteness on Social Media
  6. Resettlement as a temporal border
  7. iTaukei ways of knowing and managing mangroves for ecosystem-based adaptation
  8. On the notion of ecological justice
  9. Experimental and numerical investigation of laser beam-welded Al-Cu-Li joints using micro-mechanical characteristics
  10. Ethos, Pathos, PowerPoint
  11. Clusters of water governance problems and their effects on policy delivery
  12. Career engagement
  13. Economic Values from Ecosystems
  14. Empirische Methoden
  15. Die qualitative Analyse internetbasierter Daten
  16. Covid-19 lockdown and the behavior change on physical exercise, pain and psychological well-being
  17. Design It!
  18. Effects of introspective vs. extraspective instruction in scaling of hedonic properties of flavouring ingredients by Chinese and German subjects
  19. Spatial imaginaries in flood risk management: insights from a managed retreat initiative in upper Bavaria
  20. Phonographic work
  21. Plant functional trait response to environmental drivers across European temperate forest understorey communities
  22. Credibility, information preferences, and information interests
  23. Corporate social responsibility performance, reporting and generalized methods of moments (GMM)
  24. A New Look at Errors
  25. Schreiben
  26. endo-Hydroxy-trioxa-tris-σ-homotropilidene