Best Practices in AI and Data Science Models Evaluation
Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review
Authors
Evaluating Artificial Intelligence (AI) and data science models is crucial to ensure their reliability, fairness, and applicability in real-world scenarios. This paper highlights best practices for model evaluation, emphasizing the importance of selecting appropriate metrics aligned with business or research goals. Key considerations include using robust validation strategies (e.g., cross-validation), monitoring for overfitting, and ensuring data splits preserve class distributions. Fairness, interpretability, and reproducibility are essential, particularly in high-stakes domains like healthcare or finance. Additionally, evaluating models across multiple datasets or demographic subgroups helps uncover biases and improve generalizability. Adopting standardized reporting practices and
open-source benchmarks further strengthens the evaluation process. By adhering to these practices, practitioners can build more trustworthy and effective AI systems.
open-source benchmarks further strengthens the evaluation process. By adhering to these practices, practitioners can build more trustworthy and effective AI systems.
| Original language | English |
|---|---|
| Title of host publication | INFORMATIK 2025 : The Wide Open - Offenheit von Source bis Science, 16.-19.September 2025 Potsdam |
| Editors | Ulrike Lucke, Stefan Stieglitz, Falk Uebernickel, Anna-Lena Lamprecht, Maike Klein |
| Number of pages | 9 |
| Place of Publication | Bonn |
| Publisher | Gesellschaft für Informatik, Bonn |
| Publication date | 2025 |
| Pages | 1211-1219 |
| DOIs | |
| Publication status | Published - 2025 |
- Business informatics - AI, Data science, Best Practices, Machine learning, Evaluation
