Metrics for Experimentation Programs: Categories, Benefits and Challenges
Publikation: Beiträge in Sammelwerken › Aufsätze in Konferenzbänden › Forschung › begutachtet
Authors
Experimentation programs are vital for enabling data-driven decision-making within product development. However, evaluating their overarching success remains a significant challenge. Current metrics, such as conversion rates, primarily focus on individual experiments, leaving a gap in assessing broader program efficiency and impact. This paper addresses this gap by presenting a structured overview and analysis of 18 program-level metrics, categorized into six domains: Volume, Outcome-Based, Quality, Engagement, Process Efficiency and Strategic Alignment. Metrics such as experimentation throughput, time-to-decision and experimentation coverage are examined for their implications on operational efficiency, cultural adoption, and strategic alignment. Based on interviews with 48 experimentation practitioners, this work provides a description of these metrics and discusses their benefits and challenges. The results offer actionable insights for advancing experimentation practices and aligning them with organizational goals.
Originalsprache | Englisch |
---|---|
Titel | Agile Processes in Software Engineering and Extreme Programming : 26th International Conference on Agile Software Development, XP 2025, Brugg-Windisch, Switzerland, June 2–5, 2025, Proceedings |
Herausgeber | Sibylle Peter, Martin Kropp, Ademar Aguiar, Craig Anslow, Maria Ilaria Lunesu, Andrea Pinna |
Anzahl der Seiten | 15 |
Erscheinungsort | Cham |
Verlag | Springer Nature |
Erscheinungsdatum | 2025 |
Seiten | 210-225 |
ISBN (Print) | 978-3-031-94543-4 |
ISBN (elektronisch) | 978-3-031-94544-1 |
DOIs | |
Publikationsstatus | Erschienen - 2025 |
Veranstaltung | 26th International Conference on Agile Software Development - XP 2025 - Brugg-Windisch, Schweiz Dauer: 02.06.2025 → 05.06.2025 |
- Wirtschaftsinformatik