Developing a sustainable platform for entity annotation benchmarks
Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review
Authors
The existing entity annotation systems that drive the extraction of RDF from unstructured data are hard to compare as their evaluation relies on different data sets and measures. We developed GERBIL, an evaluation framework for semantic entity annotation that provides developers, end users and researchers with easy-to-use interfaces for the agile, fine-grained and uniform evaluation of 9 annotation tools on 11 different data sets within 6 different experimental settings on 6 different measures. In this paper, we present the developed interfaces, data flows and data structures. Moreover, we show how GERBIL supports a better reproducibility and archiving of experimental results.
| Original language | English |
|---|---|
| Title of host publication | The Semantic Web : ESWC 2015 Satellite Events - ESWC 2015 Satellite Events |
| Editors | Antoine Zimmermann, Serena Villata, John Breslin, Catherine Faron-Zucker, Fabien Gandon, Christophe Guéret |
| Number of pages | 7 |
| Publisher | Springer International Publishing AG |
| Publication date | 01.01.2015 |
| Pages | 190-196 |
| ISBN (Print) | 978-3-319-25638-2 |
| ISBN (Electronic) | 978-3-319-25639-9 |
| DOIs | |
| Publication status | Published - 01.01.2015 |
| Externally published | Yes |
| Event | 12th European Semantic Web Conference - ESWC 2015 - Portoroz, Slovenia Duration: 31.05.2015 → 04.06.2015 Conference number: 12 https://2015.eswc-conferences.org/index.html https://2015.eswc-conferences.org/call-challenges.html |
Bibliographical note
Parts of this work were supported by the FP7 project GeoKnow (GA No. 318159) and the BMWi project SAKE (GA No. 01MD15006E).
Publisher Copyright:
© Springer International Publishing Switzerland 2015.
- Informatics
- Business informatics