Insights into the accuracy of social scientists’ forecasts of societal change

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Igor Grossmann
  • Amanda Rotella
  • Cendri A. Hutcherson
  • Konstantyn Sharpinskyi
  • Michael E.W. Varnum
  • Sebastian Achter
  • Mandeep K. Dhami
  • Xinqi Evie Guo
  • Mane Kara-Yakoubian
  • David R. Mandel
  • Louis Raes
  • Louis Tay
  • Aymeric Vie
  • Lisa Wagner
  • Matus Adamkovic
  • Arash Arami
  • Patrícia Arriaga
  • Kasun Bandara
  • Gabriel Baník
  • František Bartoš
  • Ernest Baskin
  • Christoph Bergmeir
  • Michał Białek
  • Caroline K. Børsting
  • Dillon T. Browne
  • Eugene M. Caruso
  • Rong Chen
  • Bin Tzong Chie
  • William J. Chopik
  • Robert N. Collins
  • Chin Wen Cong
  • Lucian G. Conway
  • Matthew Davis
  • Martin V. Day
  • Nathan A. Dhaliwal
  • Justin D. Durham
  • Martyna Dziekan
  • Christian T. Elbaek
  • Eric Shuman
  • Marharyta Fabrykant
  • Mustafa Firat
  • Geoffrey T. Fong
  • Jeremy A. Frimer
  • Jonathan M. Gallegos
  • Simon B. Goldberg
  • Anton Gollwitzer
  • Julia Goyal
  • Lorenz Graf-Vlachy

How well can social scientists predict societal change, and what processes underlie their predictions? To answer these questions, we ran two forecasting tournaments testing the accuracy of predictions of societal change in domains commonly studied in the social sciences: ideological preferences, political polarization, life satisfaction, sentiment on social media, and gender–career and racial bias. After we provided them with historical trend data on the relevant domain, social scientists submitted pre-registered monthly forecasts for a year (Tournament 1; N = 86 teams and 359 forecasts), with an opportunity to update forecasts on the basis of new data six months later (Tournament 2; N = 120 teams and 546 forecasts). Benchmarking forecasting accuracy revealed that social scientists’ forecasts were on average no more accurate than those of simple statistical models (historical means, random walks or linear regressions) or the aggregate forecasts of a sample from the general public (N = 802). However, scientists were more accurate if they had scientific expertise in a prediction domain, were interdisciplinary, used simpler models and based predictions on prior data.

Original languageEnglish
JournalNature Human Behaviour
Volume7
Issue number4
Pages (from-to)484-501
Number of pages18
DOIs
Publication statusPublished - 04.2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2023, The Author(s), under exclusive licence to Springer Nature Limited.

Recently viewed

Researchers

  1. Lena Holz

Publications

  1. Leaf Attenuated Total Reflection Fourier Transform Infrared (ATR-FTIR) biochemical profile of grassland plant species related to land-use intensity
  2. Monument for a Forgotten Future
  3. A synthesis of atmospheric mercury depletion event chemistry in the atmosphere and snow
  4. Zur Mikrostruktur des Exportbooms
  5. Effects of extrusion ratio and annealing treatment on the mechanical properties and microstructure of a Mg–11Gd–4.5Y–1Nd–1.5Zn–0.5Zr (wt%) alloy
  6. Under Which Conditions Do Populist Governments Use Unpolitics in EU Decision‐Making
  7. Kooperation und Diversität von Netzwerken
  8. Mobile Geographie
  9. Traps in transition - A biographical approach to forms of collaboration between youth welfare services and employment promotion agencies
  10. Part I: Too much change is not enough
  11. Erfolgreiche Unternehmer
  12. Markierungen in Sprache und Raum
  13. Does ownership structure impact carbon performance and reporting?
  14. Unternehmensnahe Instrumente
  15. J.R. Searle
  16. "The skin and fur on your shoulders"
  17. Alex Callinicos, The Resources of Critique, Polity Press, Cambridge, 2006
  18. Personal and regional determinants of entrepreneurial activities
  19. The communicative constitution of academic fields in the digital age
  20. Der Sozialindex für Hamburger Schulen
  21. Sprachunterricht in der Primarstufe
  22. Dinge und Körper
  23. Feuilleton
  24. TIMSS
  25. No longer second-class citizens
  26. Problemorientiertes Lernen
  27. (Un)typisch Gender Studies
  28. Plastizität
  29. Indikatorenmodell des schulischen Schreibens
  30. Author Correction: Widening global variability in grassland biomass since the 1980s
  31. Export entry and exit by German firms
  32. "Mit einem Lineal kann man messen"
  33. Was hat ein Aral-Plakat mit Kunst zu tun?
  34. DESI
  35. Export intensity and plant characteristics
  36. DESI - Text Production
  37. Innovative public governance in times of crisis