Insights into the accuracy of social scientists’ forecasts of societal change

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

  • Igor Grossmann
  • Amanda Rotella
  • Cendri A. Hutcherson
  • Konstantyn Sharpinskyi
  • Michael E.W. Varnum
  • Sebastian Achter
  • Mandeep K. Dhami
  • Xinqi Evie Guo
  • Mane Kara-Yakoubian
  • David R. Mandel
  • Louis Raes
  • Louis Tay
  • Aymeric Vie
  • Lisa Wagner
  • Matus Adamkovic
  • Arash Arami
  • Patrícia Arriaga
  • Kasun Bandara
  • Gabriel Baník
  • František Bartoš
  • Ernest Baskin
  • Christoph Bergmeir
  • Michał Białek
  • Caroline K. Børsting
  • Dillon T. Browne
  • Eugene M. Caruso
  • Rong Chen
  • Bin Tzong Chie
  • William J. Chopik
  • Robert N. Collins
  • Chin Wen Cong
  • Lucian G. Conway
  • Matthew Davis
  • Martin V. Day
  • Nathan A. Dhaliwal
  • Justin D. Durham
  • Martyna Dziekan
  • Christian T. Elbaek
  • Eric Shuman
  • Marharyta Fabrykant
  • Mustafa Firat
  • Geoffrey T. Fong
  • Jeremy A. Frimer
  • Jonathan M. Gallegos
  • Simon B. Goldberg
  • Anton Gollwitzer
  • Julia Goyal
  • Lorenz Graf-Vlachy

How well can social scientists predict societal change, and what processes underlie their predictions? To answer these questions, we ran two forecasting tournaments testing the accuracy of predictions of societal change in domains commonly studied in the social sciences: ideological preferences, political polarization, life satisfaction, sentiment on social media, and gender–career and racial bias. After we provided them with historical trend data on the relevant domain, social scientists submitted pre-registered monthly forecasts for a year (Tournament 1; N = 86 teams and 359 forecasts), with an opportunity to update forecasts on the basis of new data six months later (Tournament 2; N = 120 teams and 546 forecasts). Benchmarking forecasting accuracy revealed that social scientists’ forecasts were on average no more accurate than those of simple statistical models (historical means, random walks or linear regressions) or the aggregate forecasts of a sample from the general public (N = 802). However, scientists were more accurate if they had scientific expertise in a prediction domain, were interdisciplinary, used simpler models and based predictions on prior data.

OriginalspracheEnglisch
ZeitschriftNature Human Behaviour
Jahrgang7
Ausgabenummer4
Seiten (von - bis)484-501
Anzahl der Seiten18
DOIs
PublikationsstatusErschienen - 04.2023
Extern publiziertJa

DOI

Zuletzt angesehen

Publikationen

  1. Reversed effects of grazing on plant diversity
  2. How to Assess Knowledge Cumulation in Environmental Governance Research? Conceptual and Empirical Explorations
  3. How to Induce an Error Management Climate
  4. Belief in Free Will Is Related to Internal Attribution in Self-Perception
  5. Chicago's embedded artist as double agent
  6. Numerical dynamic simulation and analysis of a lithium bromide/water long term solar heat storage system
  7. A Dying Theory? A Critical Assessment of Some Aspects of Status Inconsistency Research 1950-1983
  8. Self-regulatory thought across time and domains
  9. Application of stress intensity factor superposition in residual stress fields considering crack closure
  10. Remotely sensed effectiveness assessments of protected areas lack a common framework
  11. "How Bad Was He? Let Me Count the Ways"
  12. Beyond the “local”
  13. Albert Viethen
  14. Das Langzeitpraktikum in Corona-Zeiten
  15. Towards 3D Process Simulation for In Situ Hybridization of Fiber-Metal-Laminates (FML)
  16. Cross-Channel Real-Time Response Analysis
  17. y-Randomization and its variants in QSPR/QSAR
  18. Prototypische Lehr-Lern-Bausteine
  19. Ringen um Sinn
  20. How to protect the truth? Challenges of cybersecurity, investigative journalism and whistleblowing in times of surveillance capitalism.
  21. Emotional states of drivers and the impact on speed, acceleration and traffic violations - A simulator study
  22. Sozialfaschismusthese
  23. Studiengang "Master in Auditing" an der Leuphana Universität Lüneburg
  24. Bioconversion of agri-food residues into lactic acid
  25. Shifting Competency Requirements for IT Professionals in the Digital Transformation: A Competency Transformation Process Model
  26. Grundsatzfragen und Paradoxien für die Netzwerkarbeit in BBS futur 2.0