Toward a modular evaluation approach of real-world laboratories: Findings from a literature review

Research output: Journal contributionsScientific review articlesResearch

Authors

The number of real-world laboratories (RwLs) as research settings to address sustainability problems by using collaborative and experimental approaches has been growing steadily over the past years. RwLs are widely considered promising settings for the production of action-orientated knowledge in order to contribute solving wicked real-world problems such as climate change. However, empirically tested evaluative approaches are rare. We argue that evaluations within RwLs are crucial for ensuring high-quality and impactful research, amplifying tested solution approaches, and driving innovative forms of transdisciplinary collaboration. At the same time, evaluations within RwLs seem difficult due to the multilayered structure of RwLs. In order to provide guidance regarding the evaluation in RwLs-for researchers and practitioners, we conduct a scoping literature review that encompasses a comprehensive understanding of RwLs. We identify studies in which the specific components of RwLs lab context, experiments, and interventions -are empirically evaluated. Drawing on our findings, we derive different types of approaches that can be used for evaluating RwLs in practice. Based on how labs, experiments, and interventions in real-world settings have been evaluated in practice so far, we suggest to design evaluation approaches depending on (1) what should exactly be evaluated in the specific RwL, (2) for which purpose, and (3) by whom. We hope this targeted, modular evaluation approach based on evaluation types found in literature will help actors engaged in RwLs to make evaluations more feasible and impactful.

Original languageEnglish
JournalResearch Evaluation
Volume32
Issue number1
Pages (from-to)128-143
Number of pages16
ISSN0958-2029
DOIs
Publication statusPublished - 01.01.2023

Bibliographical note

This work was supported by the German Federal Ministry of Education and Research [13ZS0058B].

Publisher Copyright:
© 2022 The Author(s). Published by Oxford University Press.

DOI

Recently viewed

Publications

  1. Can management-sponsored non-binding remuneration votes shape the executive compensation structure?
  2. Life satisfaction in Germany after reunification: Additional insights on the pattern of convergence
  3. The monetary value of cultural goods
  4. Stakeholder involvement for Water Framework Directive implementation in Germany
  5. Modelling habitat and spatial distribution of an endangered longhorn beetle
  6. Does SMS-support make a difference? Effectiveness of a two-week online-training to overcome procrastination.
  7. Attribution of Egoistic Versus Altruistic Motives to Acts of Helping
  8. Mythen der Edda in der deutschen Dichtung
  9. Introduction - How prenatal diagnosis is entangled in historical and social contexts
  10. The geometry of habitat fragmentation
  11. The reception of trust in different legal systems: some lessons for Vietnam; a comparative study
  12. Prototypische Lehr-Lern-Bausteine
  13. Investigations on hot tearing of Mg-Al binary alloys by using a new quantitative method
  14. Sustainable entrepreneurship: creating environmental solutions in light of planetary boundaries
  15. Glen Mills Schools
  16. Tanja Dückers - Essay
  17. Aufbruch
  18. Facilitating regional energy transition strategies:
  19. Learning to Rate Player Positioning in Soccer
  20. Evolution and transformation of early modern cosmological knowledge
  21. Diversity-enhanced canopy space occupation and leaf functional diversity jointly promote overyielding in tropical tree communities
  22. Geschäftsprozessintegration mit SAP
  23. Inter-annual rainfall variability in Central Asia - A contribution to the discussion on the importance of environmental stochasticity in drylands
  24. Which it seeks to advance in the wider world
  25. How do conflicts impact change in family businesses?
  26. Digital innovation and transformation
  27. Union Density and Determinations of Union Membership in 18 EU Countries
  28. Erforschung multidiskursiver Organisationen
  29. Collisionless damping in the spectra of active plasma resonance spectroscopic probes
  30. AAL-Onto
  31. Psychophysiological Correlates of Flow-Experience
  32. Drivers and Barriers of Implementing Sustainability Curricula in Higher Education - Assumptions and Evidence
  33. Trait emotional intelligence facilitates responses to a social gambling task
  34. Kinetic Spectra of the Planar Multipole Resonance Probe
  35. Selbstwerden
  36. "Wozu braucht es noch Bibliotheken? Analyse des IFLA-Trend-Reports"