Metrics for Experimentation Programs: Categories, Benefits and Challenges

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

Experimentation programs are vital for enabling data-driven decision-making within product development. However, evaluating their overarching success remains a significant challenge. Current metrics, such as conversion rates, primarily focus on individual experiments, leaving a gap in assessing broader program efficiency and impact. This paper addresses this gap by presenting a structured overview and analysis of 18 program-level metrics, categorized into six domains: Volume, Outcome-Based, Quality, Engagement, Process Efficiency and Strategic Alignment. Metrics such as experimentation throughput, time-to-decision and experimentation coverage are examined for their implications on operational efficiency, cultural adoption, and strategic alignment. Based on interviews with 48 experimentation practitioners, this work provides a description of these metrics and discusses their benefits and challenges. The results offer actionable insights for advancing experimentation practices and aligning them with organizational goals.
OriginalspracheEnglisch
TitelAgile Processes in Software Engineering and Extreme Programming : 26th International Conference on Agile Software Development, XP 2025, Brugg-Windisch, Switzerland, June 2–5, 2025, Proceedings
HerausgeberSibylle Peter, Martin Kropp, Ademar Aguiar, Craig Anslow, Maria Ilaria Lunesu, Andrea Pinna
Anzahl der Seiten16
ErscheinungsortCham
VerlagSpringer Nature
Erscheinungsdatum2025
Seiten210-225
ISBN (Print)978-3-031-94543-4
ISBN (elektronisch)978-3-031-94544-1
DOIs
PublikationsstatusErschienen - 2025
Veranstaltung26th International Conference on Agile Software Development - XP 2025 - Brugg-Windisch, Schweiz
Dauer: 02.06.202505.06.2025

Bibliographische Notiz

Publisher Copyright:
© The Author(s) 2025.

DOI

Zuletzt angesehen

Forschende

  1. Thomas Rheker

Publikationen

  1. The explanatory power of Carnegie Classification in predicting engagement indicators
  2. The erosion of relational values resulting from landscape simplification
  3. Peter Hay, Advanced Introduction to Private International Law and Procedure
  4. Locus of control
  5. Arc spraying of WCFeCSiMn cored wires.
  6. Process limits of extrusion of multimaterial components
  7. Comparison of different machine control modes during friction extrusion of AA2024
  8. Simulation of stresses during casting of binary magnesium-aluminum alloys
  9. Why Emergency? Reflections on the Practice and Rhetoric of Exceptionalism
  10. Die Schreibwerkstatt Mehrsprachigkeit
  11. Gas-Kampf oder Gas-Krampf
  12. Tschick
  13. Strategy execution in higher education
  14. The theory of human development
  15. The causal effects of exports on firm size and labor productivity
  16. Efficacy of a Web-Based Stress Management Intervention for Beginning Teachers on Reducing Stress and Mechanisms of Change
  17. Between Usability and Trustworthiness-The Potential of Information Transfer Using Digital Information Platforms for Refugees
  18. Learning from Indigenous Populations and Local Communities
  19. Telling your own stories
  20. From farm to factory. Vertical trading and processing structures between industrial and developing countries in the international tobacco-economy
  21. Contextualising urban experimentation
  22. Reintegration strategies in a gender perspective
  23. Tackling the habitat fragmentation panchreston
  24. Professionalising teachers for inquiry-based science education - challenges and limits
  25. Global Sourcing