Metrics for Experimentation Programs: Categories, Benefits and Challenges

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

Experimentation programs are vital for enabling data-driven decision-making within product development. However, evaluating their overarching success remains a significant challenge. Current metrics, such as conversion rates, primarily focus on individual experiments, leaving a gap in assessing broader program efficiency and impact. This paper addresses this gap by presenting a structured overview and analysis of 18 program-level metrics, categorized into six domains: Volume, Outcome-Based, Quality, Engagement, Process Efficiency and Strategic Alignment. Metrics such as experimentation throughput, time-to-decision and experimentation coverage are examined for their implications on operational efficiency, cultural adoption, and strategic alignment. Based on interviews with 48 experimentation practitioners, this work provides a description of these metrics and discusses their benefits and challenges. The results offer actionable insights for advancing experimentation practices and aligning them with organizational goals.
OriginalspracheEnglisch
TitelAgile Processes in Software Engineering and Extreme Programming : 26th International Conference on Agile Software Development, XP 2025, Brugg-Windisch, Switzerland, June 2–5, 2025, Proceedings
HerausgeberSibylle Peter, Martin Kropp, Ademar Aguiar, Craig Anslow, Maria Ilaria Lunesu, Andrea Pinna
Anzahl der Seiten16
ErscheinungsortCham
VerlagSpringer Nature
Erscheinungsdatum2025
Seiten210-225
ISBN (Print)978-3-031-94543-4
ISBN (elektronisch)978-3-031-94544-1
DOIs
PublikationsstatusErschienen - 2025
Veranstaltung26th International Conference on Agile Software Development - XP 2025 - Brugg-Windisch, Schweiz
Dauer: 02.06.202505.06.2025

Bibliographische Notiz

Publisher Copyright:
© The Author(s) 2025.

DOI

Zuletzt angesehen

Forschende

  1. Stephan Scheel

Publikationen

  1. A Trajectory Generation Algorithm for Optimal Consumption in Electromagnetic Actuators
  2. General management principles and a checklist of strategies to guide forest biodiversity conservation
  3. Development of a Parameterized Model for Additively Manufactured Dies to Control the Strains in Extrudates
  4. Stressing the Relevance of Differentiating between Systematic and Random Measurement Errors in Ultrasound Muscle Thickness Diagnostics
  5. The buffering effect of selection, optimization, and compensation strategy use on the relationship between problem solving demands and occupational well-being
  6. Bayesian Parameter Estimation in Green Business Process Management
  7. What motivates people to use energy feedback systems? A multiple goal approach to predict long-term usage behaviour in daily life
  8. A Process Perspective on Organizational Failure
  9. Design of Reliable Remobilisation Finger Implants with Geometry Elements of a Triple Periodic Minimal Surface Structure via Additive Manufacturing of Silicon Nitride
  10. Emotional text design in multimedia learning
  11. Evaluating A Teaching-Learning Sequence (TLS) About Acid-Base Reactions In Upper Secondary School
  12. Implementation of Chemometric Tools to Improve Data Mining and Prioritization in LC-HRMS for Nontarget Screening of Organic Micropollutants in Complex Water Matrixes
  13. Application of design of experiments for laser shock peening process optimization
  14. Explicit references in chat-based CSCL
  15. On the role of linguistic features for comprehension and learning from STEM texts. A meta-analysis
  16. Developing robust field survey protocols in landscape ecology
  17. Challenging the status quo of accelerator research: Concluding remarks
  18. Effects of accuracy feedback on fractal characteristics of time estimation
  19. Modeling Individual Differences in Children’s Information Integration During Pragmatic Word Learning
  20. Detection of coherent oceanic structures via transfer operators
  21. Integrating business models and enterprise architecture
  22. Understanding the modes of use and availability of critical metals-An expert-based scenario analysis for the case of indium
  23. Walk counts, labyrinthicity, and complexity of acyclic and cyclic graphs and molecules.
  24. TANGO: A reliable, open-source, browser-based task to assess individual differences in gaze understanding in 3 to 5-year-old children and adults
  25. Parametric finite element model and mechanical characterisation of electrospun materials for biomedical applications
  26. When, Where, and How Nature Matters for Ecosystem Services
  27. Adaptive Item Selection Under Matroid Constraints
  28. Depression-specific Costs and their Factors based on SHI Routine data