Insights into the accuracy of social scientists’ forecasts of societal change

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

  • Igor Grossmann
  • Amanda Rotella
  • Cendri A. Hutcherson
  • Konstantyn Sharpinskyi
  • Michael E.W. Varnum
  • Sebastian Achter
  • Mandeep K. Dhami
  • Xinqi Evie Guo
  • Mane Kara-Yakoubian
  • David R. Mandel
  • Louis Raes
  • Louis Tay
  • Aymeric Vie
  • Lisa Wagner
  • Matus Adamkovic
  • Arash Arami
  • Patrícia Arriaga
  • Kasun Bandara
  • Gabriel Baník
  • František Bartoš
  • Ernest Baskin
  • Christoph Bergmeir
  • Michał Białek
  • Caroline K. Børsting
  • Dillon T. Browne
  • Eugene M. Caruso
  • Rong Chen
  • Bin Tzong Chie
  • William J. Chopik
  • Robert N. Collins
  • Chin Wen Cong
  • Lucian G. Conway
  • Matthew Davis
  • Martin V. Day
  • Nathan A. Dhaliwal
  • Justin D. Durham
  • Martyna Dziekan
  • Christian T. Elbaek
  • Eric Shuman
  • Marharyta Fabrykant
  • Mustafa Firat
  • Geoffrey T. Fong
  • Jeremy A. Frimer
  • Jonathan M. Gallegos
  • Simon B. Goldberg
  • Anton Gollwitzer
  • Julia Goyal
  • Lorenz Graf-Vlachy

How well can social scientists predict societal change, and what processes underlie their predictions? To answer these questions, we ran two forecasting tournaments testing the accuracy of predictions of societal change in domains commonly studied in the social sciences: ideological preferences, political polarization, life satisfaction, sentiment on social media, and gender–career and racial bias. After we provided them with historical trend data on the relevant domain, social scientists submitted pre-registered monthly forecasts for a year (Tournament 1; N = 86 teams and 359 forecasts), with an opportunity to update forecasts on the basis of new data six months later (Tournament 2; N = 120 teams and 546 forecasts). Benchmarking forecasting accuracy revealed that social scientists’ forecasts were on average no more accurate than those of simple statistical models (historical means, random walks or linear regressions) or the aggregate forecasts of a sample from the general public (N = 802). However, scientists were more accurate if they had scientific expertise in a prediction domain, were interdisciplinary, used simpler models and based predictions on prior data.

OriginalspracheEnglisch
ZeitschriftNature Human Behaviour
Jahrgang7
Ausgabenummer4
Seiten (von - bis)484-501
Anzahl der Seiten18
DOIs
PublikationsstatusErschienen - 04.2023
Extern publiziertJa

DOI

Zuletzt angesehen

Publikationen

  1. Spatial scale affects seed predation and dispersal in contrasting anthropogenic landscapes
  2. Albert Viethen
  3. Can promoting compassion and gratitude through a four-week online training program improve women's mental health? A randomized controlled trial
  4. Towards a ‘Sustainable University’
  5. Threshold stress during tensile and compressive creep in AE42 magnesium alloy
  6. The technology-mindset interactions
  7. Am Grund des Anderen
  8. Moving beyond the heuristic of creative destruction
  9. Anstelle des Staates
  10. Skizze
  11. OH-radical reactivity and direct photolysis of triphenyltin hydroxide in aqueous solution
  12. Fostering preservice teachers’ noticing with structured video feedback: Results of an online- and video-based intervention study
  13. Scoping Review of Existing Evaluations of Smokeless Tobacco Control Policies
  14. Industrial relations without conflicts and state interference?
  15. Environmental capacity and airport operations
  16. The Making of Les Immatériaux
  17. The hidden power of language
  18. Datenbasierte Selbst- und Fremdevaluation
  19. Changing mass priorities
  20. Environmental commitments and rhetoric over the Pandemic crisis
  21. Widerstand und Antisemitismus
  22. An intra-firm perspective on wage profiles and employment of older workers with special reference to human capital and deferred compensation
  23. A dynamic account of self-efficacy in entrepreneurship
  24. Assessment of key competencies
  25. Gaseous nitrogen losses from urea applied to maize on a calcareous fluvo-aquic soil in the North China Plain
  26. § 347
  27. Foliar application of lambda-cyhalothrin modulates root exudate profile and the rhizosphere bacteria community of dioecious Populus cathayana
  28. Environmental factors and seasonal variation in density of mussel larvae (Mytilus edulis) in Danish waters
  29. Supply chain management and reverse logistics
  30. Effect of the gap width in AZ31 magnesium alloy joints obtained by friction stir welding
  31. Correction: Establishing an infrastructure for collaboration in primate cognition research(PLoS ONE (2019) 14:10(e0223675) DOI: 10.1371/journal.pone.0223675)
  32. Management and organization in the work of Michel houellebecq unplugged - voices
  33. Corruption and Social Values
  34. Messen, evaluieren, regulieren
  35. § 177a
  36. Fallstudie
  37. Robert Kolb: Bound Choice, Election, and Wittenberg theological Method. From Martin Luther to the Formula of Concord, Grand Rapids / Cambridge 2005