Metrics for Experimentation Programs: Categories, Benefits and Challenges

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

Experimentation programs are vital for enabling data-driven decision-making within product development. However, evaluating their overarching success remains a significant challenge. Current metrics, such as conversion rates, primarily focus on individual experiments, leaving a gap in assessing broader program efficiency and impact. This paper addresses this gap by presenting a structured overview and analysis of 18 program-level metrics, categorized into six domains: Volume, Outcome-Based, Quality, Engagement, Process Efficiency and Strategic Alignment. Metrics such as experimentation throughput, time-to-decision and experimentation coverage are examined for their implications on operational efficiency, cultural adoption, and strategic alignment. Based on interviews with 48 experimentation practitioners, this work provides a description of these metrics and discusses their benefits and challenges. The results offer actionable insights for advancing experimentation practices and aligning them with organizational goals.
OriginalspracheEnglisch
TitelAgile Processes in Software Engineering and Extreme Programming : 26th International Conference on Agile Software Development, XP 2025, Brugg-Windisch, Switzerland, June 2–5, 2025, Proceedings
HerausgeberSibylle Peter, Martin Kropp, Ademar Aguiar, Craig Anslow, Maria Ilaria Lunesu, Andrea Pinna
Anzahl der Seiten16
ErscheinungsortCham
VerlagSpringer Nature
Erscheinungsdatum2025
Seiten210-225
ISBN (Print)978-3-031-94543-4
ISBN (elektronisch)978-3-031-94544-1
DOIs
PublikationsstatusErschienen - 2025
Veranstaltung26th International Conference on Agile Software Development - XP 2025 - Brugg-Windisch, Schweiz
Dauer: 02.06.202505.06.2025

Bibliographische Notiz

Publisher Copyright:
© The Author(s) 2025.

DOI

Zuletzt angesehen

Publikationen

  1. The explanatory power of Carnegie Classification in predicting engagement indicators
  2. Effectiveness of Web- and Mobile-Based Treatment of Subthreshold Depression With Adherence-Focused Guidance
  3. Junior High School Students’ Length Estimation Skills and Use of Strategies for Making Estimations
  4. Mapping ecosystem services in Colombia
  5. Sustainable Development and Material Flows
  6. Data practices in apps from Brazil: What do privacy policies inform us about?
  7. Back to the future
  8. The Meaning of Higher-Order Factors in Reflective-Measurement Models
  9. Towards a socio-cognitive approach to knowledge transfer
  10. Variational Pragmatics
  11. The importance of product lifetime labelling for purchase decisions
  12. Foliar Endophytic Fungal Communities Are Driven by Leaf Traits—Evidence From a Temperate Tree Diversity Experiment
  13. Principals between exploitation and exploration
  14. Neuro-Symbolic Relation Extraction
  15. Establishment age and wages
  16. Tree and mycorrhizal fungal diversity drive intraspecific and intraindividual trait variation in temperate forests
  17. Mindfulness as an intervention to improve self-control
  18. Navigating (In)Visibility
  19. Analysis of Cognitively Activating Tasks in Vocational Education and Training of Nursing
  20. Aufgeschoben, nicht aufgehoben
  21. Composing with the terra fluida of interaction: new paths for CCO research as relational practice
  22. The conservation against development paradigm in protected areas
  23. Possible underestimations of risks for the environment due to unregulated emissions of biocides from households to wastewater
  24. Why Emergency? Reflections on the Practice and Rhetoric of Exceptionalism
  25. Powers of Abstraction
  26. Front, Field, Line, Plane
  27. A Kalman estimator for detecting repetitive disturbances
  28. Circularity in Automotive Electronics Design
  29. Effectiveness of an Internet- and App-Based Intervention for College Students With Elevated Stress
  30. Temporal variability in native plant composition clouds impact of increasing non-native richness along elevational gradients in Tenerife
  31. Effects of Soil Properties, Temperature and Disturbance on Diversity and Functional Composition of Plant Communities Along a Steep Elevational Gradient on Tenerife
  32. A cultural approach toward the notion of the instrument