Developing a sustainable platform for entity annotation benchmarks
Publikation: Beiträge in Sammelwerken › Aufsätze in Konferenzbänden › Forschung › begutachtet
Authors
The existing entity annotation systems that drive the extraction of RDF from unstructured data are hard to compare as their evaluation relies on different data sets and measures. We developed GERBIL, an evaluation framework for semantic entity annotation that provides developers, end users and researchers with easy-to-use interfaces for the agile, fine-grained and uniform evaluation of 9 annotation tools on 11 different data sets within 6 different experimental settings on 6 different measures. In this paper, we present the developed interfaces, data flows and data structures. Moreover, we show how GERBIL supports a better reproducibility and archiving of experimental results.
| Originalsprache | Englisch |
|---|---|
| Titel | The Semantic Web : ESWC 2015 Satellite Events - ESWC 2015 Satellite Events |
| Herausgeber | Antoine Zimmermann, Serena Villata, John Breslin, Catherine Faron-Zucker, Fabien Gandon, Christophe Guéret |
| Anzahl der Seiten | 7 |
| Verlag | Springer International Publishing AG |
| Erscheinungsdatum | 01.01.2015 |
| Seiten | 190-196 |
| ISBN (Print) | 978-3-319-25638-2 |
| ISBN (elektronisch) | 978-3-319-25639-9 |
| DOIs | |
| Publikationsstatus | Erschienen - 01.01.2015 |
| Extern publiziert | Ja |
| Veranstaltung | 12th European Semantic Web Conference - ESWC 2015 - Portoroz, Slowenien Dauer: 31.05.2015 → 04.06.2015 Konferenznummer: 12 https://2015.eswc-conferences.org/index.html https://2015.eswc-conferences.org/call-challenges.html |
Bibliographische Notiz
Funding Information:
Parts of this work were supported by the FP7 project GeoKnow (GA No. 318159) and the BMWi project SAKE (GA No. 01MD15006E).
Publisher Copyright:
© Springer International Publishing Switzerland 2015.
- Informatik
- Wirtschaftsinformatik