Analytic reproducibility in articles receiving open data badges at the journal Psychological Science: An observational study

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

  • Tom E. Hardwicke
  • Manuel Bohn
  • Kyle MacDonald
  • Emily Hembacher
  • Michèle B. Nuijten
  • Benjamin N. Peloquin
  • Benjamin E. Demayo
  • Bria Long
  • Erica J. Yoon
  • Michael C. Frank

For any scientific report, repeating the original analyses upon the original data should yield the original outcomes. We evaluated analytic reproducibility in 25 Psychological Science articles awarded open data badges between 2014 and 2015. Initially, 16 (64%, 95% confidence interval [43,81]) articles contained at least one 'major numerical discrepancy' (>10% difference) prompting us to request input from original authors. Ultimately, target values were reproducible without author involvement for 9 (36% [20,59]) articles; reproducible with author involvement for 6 (24% [8,47]) articles; not fully reproducible with no substantive author response for 3 (12% [0,35]) articles; and not fully reproducible despite author involvement for 7 (28% [12,51]) articles. Overall, 37 major numerical discrepancies remained out of 789 checked values (5% [3,6]), but original conclusions did not appear affected. Non-reproducibility was primarily caused by unclear reporting of analytic procedures. These results highlight that open data alone is not sufficient to ensure analytic reproducibility.

OriginalspracheEnglisch
Aufsatznummer201494
ZeitschriftRoyal Society Open Science
Jahrgang8
Ausgabenummer1
Anzahl der Seiten9
ISSN2054-5703
DOIs
PublikationsstatusErschienen - 06.01.2021
Extern publiziertJa

Bibliographische Notiz

Publisher Copyright:
© 2021 The Authors.

Dokumente

DOI

Zuletzt angesehen

Forschende

  1. Jonathan Pargätzi

Publikationen

  1. Enhancement of workability in AZ31 alloy - Processing maps
  2. Question answering over linked data
  3. Plant density modifies root system architecture in spring barley (Hordeum vulgare L.) through a change in nodal root number
  4. Land use affects dung beetle communities and their ecosystem service in forests and grasslands
  5. On the Hausdorff dimension of fractals given by certain expansions of real numbers
  6. A scale-up procedure to dialkyl carbonates; evaluation of their properties, biodegradability, and toxicity
  7. Question Answering Mediated by Visual Clues and Knowledge Graphs
  8. Can Geodesign Be Used to Facilitate Boundary Management for Planning and Implementation of Nature-based Solutions?
  9. Productive Transformations and Bilateralism in the Semi-Periphery
  10. Generating dispatching rules for semiconductor manufacturing to minimize weighted tardiness
  11. Mobilität
  12. "If you like something, you want it to develop."
  13. Rapid ecosystem change challenges the adaptive capacity of local environmental knowledge
  14. The Bigger Picture of Corruption
  15. Sustainable development indicators
  16. Structuring multiple perspectives in environmental decision-making
  17. Insights into an Action-Oriented Training Program to Promote Sustainable Entrepreneurship
  18. Fear of Infection or Justification of Social Exclusion? The Symbolic Exploitation of the Ebola Epidemic
  19. Ergebnisse einer Sparkassen-Umfrage
  20. Methoden-Muster: Partizipation und Verhandlung
  21. Introduction
  22. Benno Reifenberg (1892-1970)
  23. § 39
  24. Design of a Real Time Path of Motion Control for Manufacturing Applications
  25. Beyond carbon, more than forest? REDD plus governmentality in Indonesia