Toward a modular evaluation approach of real-world laboratories: Findings from a literature review

Research output: Journal contributionsScientific review articlesResearch

Authors

The number of real-world laboratories (RwLs) as research settings to address sustainability problems by using collaborative and experimental approaches has been growing steadily over the past years. RwLs are widely considered promising settings for the production of action-orientated knowledge in order to contribute solving wicked real-world problems such as climate change. However, empirically tested evaluative approaches are rare. We argue that evaluations within RwLs are crucial for ensuring high-quality and impactful research, amplifying tested solution approaches, and driving innovative forms of transdisciplinary collaboration. At the same time, evaluations within RwLs seem difficult due to the multilayered structure of RwLs. In order to provide guidance regarding the evaluation in RwLs-for researchers and practitioners, we conduct a scoping literature review that encompasses a comprehensive understanding of RwLs. We identify studies in which the specific components of RwLs lab context, experiments, and interventions -are empirically evaluated. Drawing on our findings, we derive different types of approaches that can be used for evaluating RwLs in practice. Based on how labs, experiments, and interventions in real-world settings have been evaluated in practice so far, we suggest to design evaluation approaches depending on (1) what should exactly be evaluated in the specific RwL, (2) for which purpose, and (3) by whom. We hope this targeted, modular evaluation approach based on evaluation types found in literature will help actors engaged in RwLs to make evaluations more feasible and impactful.

Original languageEnglish
JournalResearch Evaluation
Volume32
Issue number1
Pages (from-to)128-143
Number of pages16
ISSN0958-2029
DOIs
Publication statusPublished - 01.01.2023

Bibliographical note

This work was supported by the German Federal Ministry of Education and Research [13ZS0058B].

Publisher Copyright:
© 2022 The Author(s). Published by Oxford University Press.

DOI

Recently viewed

Publications

  1. Pragmatic acts of humour in family discourse in selected Maryam Apaokagi’s comedy skits
  2. Subverting Autocracy
  3. Corrosion behavior and microstructure of a broad range of Mg-Sn-X alloys
  4. Effects of different video- or text-based reflection stimuli on pre-service teachers’ emotions, immersion, cognitive load and knowledge-based reasoning
  5. Dimension theory of linear solenoids
  6. Red List of marine macroalgae of the Wadden Sea
  7. CAN BUSINESS MODEL COMPONENTS EXPLAIN DIGITAL START-UP SUCCESS?
  8. Experimentation for Sustainable Innovation
  9. Joint production, externalities, and the regulation of production networks
  10. Determination of rutin in green tea infusions using square-wave voltammetry with a rigid carbon-polyurethane composite electrode
  11. Multitrophic diversity in a biodiverse forest is highly nonlinear across spatial scales
  12. The emotional spectrum in traffic situations: Results of two online-studies
  13. The display makes a difference
  14. Building capacity for the science-policy interface on biodiversity and ecosystem services
  15. Multilevel Water Governance and Problems of Scale
  16. Risk Aversion and Worker Sorting into Public Sector Employment
  17. Minimal conditions of motor inductions of approach-avoidance states
  18. Consumer Online Search Behavior
  19. Managing Biodiversity Correctly
  20. Can management compensate for atmospheric nutrient deposition in heathland ecosystems?
  21. Parameters, concepts and the terminology of outer space law: a review of the essential facilities served by outer space activities and the rules of interpretation for treaty law and soft law guidelines.
  22. The impact of enactive exploration on intrinsic motivation, strategy, and performance in electronic search
  23. The internal audience of external communications
  24. Consumers' Responses to CSR Activities