Metrics for Experimentation Programs: Categories, Benefits and Challenges

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

Experimentation programs are vital for enabling data-driven decision-making within product development. However, evaluating their overarching success remains a significant challenge. Current metrics, such as conversion rates, primarily focus on individual experiments, leaving a gap in assessing broader program efficiency and impact. This paper addresses this gap by presenting a structured overview and analysis of 18 program-level metrics, categorized into six domains: Volume, Outcome-Based, Quality, Engagement, Process Efficiency and Strategic Alignment. Metrics such as experimentation throughput, time-to-decision and experimentation coverage are examined for their implications on operational efficiency, cultural adoption, and strategic alignment. Based on interviews with 48 experimentation practitioners, this work provides a description of these metrics and discusses their benefits and challenges. The results offer actionable insights for advancing experimentation practices and aligning them with organizational goals.
OriginalspracheEnglisch
TitelAgile Processes in Software Engineering and Extreme Programming : 26th International Conference on Agile Software Development, XP 2025, Brugg-Windisch, Switzerland, June 2–5, 2025, Proceedings
HerausgeberSibylle Peter, Martin Kropp, Ademar Aguiar, Craig Anslow, Maria Ilaria Lunesu, Andrea Pinna
Anzahl der Seiten16
ErscheinungsortCham
VerlagSpringer Nature
Erscheinungsdatum2025
Seiten210-225
ISBN (Print)978-3-031-94543-4
ISBN (elektronisch)978-3-031-94544-1
DOIs
PublikationsstatusErschienen - 2025
Veranstaltung26th International Conference on Agile Software Development - XP 2025 - Brugg-Windisch, Schweiz
Dauer: 02.06.202505.06.2025

Bibliographische Notiz

Publisher Copyright:
© The Author(s) 2025.

DOI

Zuletzt angesehen

Aktivitäten

  1. Auto-assistive bodily practices. A history of early haptic technologies and practices
  2. Coauthoring an interorganizational collaboration: Exploring multi-voicedness and introducing spatiotemporal orientations
  3. Reforming from Within : Lessons of Institutional Transformation in a Climate of Systemic Change
  4. Explaining the performance of participatory and collaborative governance in addressing long-term environmental policy issues
  5. De-Mystifying the Digital
  6. Language Policy and Language Learning: New Paradigms and New Challenges - LPLL 2009
  7. Different cultures, different interactional norms: Addressing variation across the Englishes (Carl von Ossietzsky Universität)
  8. The efficacy of an internet- and mobile-based stress management intervention in employees in different guidance formats: the results of three randomised controlled trials
  9. On Race & Ecocide: Thinking of New Forms of Environmentality and Eco-Colonialism
  10. Experiences on the theme of actions for sustainable development in the field of educational systems
  11. Presentation of the paper entitled "Conception and analysis of Cascaded Dual Kalman Filters as virtual sensors for mastication activity of stomatognathic craniomandibular system"
  12. University of Exeter
  13. Language Demands of the Language Market: A Predictor of Students‘ Language Skills?
  14. Where To Start? Exploring 1-Year-Students’ Preconceptions of Sustainable Development
  15. The influence of polycentricity on collaborative environmental management – the case of EU Water Framework Directive implementation in Germany