Metrics for Experimentation Programs: Categories, Benefits and Challenges

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

Experimentation programs are vital for enabling data-driven decision-making within product development. However, evaluating their overarching success remains a significant challenge. Current metrics, such as conversion rates, primarily focus on individual experiments, leaving a gap in assessing broader program efficiency and impact. This paper addresses this gap by presenting a structured overview and analysis of 18 program-level metrics, categorized into six domains: Volume, Outcome-Based, Quality, Engagement, Process Efficiency and Strategic Alignment. Metrics such as experimentation throughput, time-to-decision and experimentation coverage are examined for their implications on operational efficiency, cultural adoption, and strategic alignment. Based on interviews with 48 experimentation practitioners, this work provides a description of these metrics and discusses their benefits and challenges. The results offer actionable insights for advancing experimentation practices and aligning them with organizational goals.
OriginalspracheEnglisch
TitelAgile Processes in Software Engineering and Extreme Programming : 26th International Conference on Agile Software Development, XP 2025, Brugg-Windisch, Switzerland, June 2–5, 2025, Proceedings
HerausgeberSibylle Peter, Martin Kropp, Ademar Aguiar, Craig Anslow, Maria Ilaria Lunesu, Andrea Pinna
Anzahl der Seiten16
ErscheinungsortCham
VerlagSpringer Nature
Erscheinungsdatum2025
Seiten210-225
ISBN (Print)978-3-031-94543-4
ISBN (elektronisch)978-3-031-94544-1
DOIs
PublikationsstatusErschienen - 2025
Veranstaltung26th International Conference on Agile Software Development - XP 2025 - Brugg-Windisch, Schweiz
Dauer: 02.06.202505.06.2025

Bibliographische Notiz

Publisher Copyright:
© The Author(s) 2025.

DOI

Zuletzt angesehen

Publikationen

  1. Distributable Modular Software Framework for Manufacturing Systems
  2. Fallstudie
  3. A robust model predictive control using a feedforward structure for a hybrid hydraulic piezo actuator in camless internal combustion engines
  4. Likelihood-based panel cointegration test in the presence of a linear time trend and cross-sectional dependence
  5. Learner pragmatics at the discourse level: Staying “on topic” in a telecollaborative eTandem task
  6. Mindsets and reflection in teacher education for inclusive language classrooms
  7. Application of novel constrained friction processing method to produce fine grained biomedical Mg-Zn-Ca alloy
  8. Risk Aversion and Sorting into Public Sector Employment
  9. Can guided introspection help avoid rationalization of meat consumption?
  10. Photodegradation of micropollutants using V-UV/UV-C processes
  11. Dynamic Semantic Web Content for Museum Guides
  12. NIF4OGGD - NLP interchange format for open German governmental data
  13. Mapping water ecosystem services: Evaluating InVEST model predictions in data scarce regions
  14. Knowledge Spaces of Globalization
  15. sPlotOpen – An environmentally balanced, open-access, global dataset of vegetation plots
  16. A Model Based Feedforward Regulator Improving PI Control of an Ice-Clamping Device Activated by Thermoelectric Cooler
  17. A new magnesium alloy system
  18. Heterogenous activation of dynamic recrystallization and twinning during friction stir processing of a Cu-4Nb alloy
  19. Secret Agents
  20. Assuring a safe, secure and sustainable space environment for space activities
  21. Dynamic material flow analysis in the life cycle assessment tool chain
  22. Spatial prioritisation for conserving ecosystem services
  23. On the notion of ecological justice
  24. Three-dimensional microstructural analysis of Mg-Al-Zn alloys by synchrotron-radiation-based microtomography