Developing a sustainable platform for entity annotation benchmarks

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

The existing entity annotation systems that drive the extraction of RDF from unstructured data are hard to compare as their evaluation relies on different data sets and measures. We developed GERBIL, an evaluation framework for semantic entity annotation that provides developers, end users and researchers with easy-to-use interfaces for the agile, fine-grained and uniform evaluation of 9 annotation tools on 11 different data sets within 6 different experimental settings on 6 different measures. In this paper, we present the developed interfaces, data flows and data structures. Moreover, we show how GERBIL supports a better reproducibility and archiving of experimental results.

Original languageEnglish
Title of host publicationThe Semantic Web : ESWC 2015 Satellite Events - ESWC 2015 Satellite Events
EditorsAntoine Zimmermann, Serena Villata, John Breslin, Catherine Faron-Zucker, Fabien Gandon, Christophe Guéret
Number of pages7
PublisherSpringer International Publishing
Publication date01.01.2015
Pages190-196
ISBN (print)978-3-319-25638-2
ISBN (electronic)978-3-319-25639-9
DOIs
Publication statusPublished - 01.01.2015
Externally publishedYes
Event12th European Semantic Web Conference - ESWC 2015 - Portoroz, Slovenia
Duration: 31.05.201504.06.2015
Conference number: 12
https://2015.eswc-conferences.org/index.html
https://2015.eswc-conferences.org/call-challenges.html

Bibliographical note

Parts of this work were supported by the FP7 project GeoKnow (GA No. 318159) and the BMWi project SAKE (GA No. 01MD15006E).

Publisher Copyright:
© Springer International Publishing Switzerland 2015.

Recently viewed

Researchers

  1. Jonathan Pargätzi

Activities

  1. Digitalization and cross-border knowledge transfer: The impact on international assignments
  2. Analyzing diary data: The relationships between activities and the individual mood level
  3. Institute for Advanced Study Princeton
  4. Contingencies of Art Policy: Comparing Probabilistic and Deterministic Cultural Planning Modes in Baltimore and Hamburg
  5. ECPR Joint Sessions of Workshops 2009
  6. Supply Chain Management – Current Practices and Future Developments
  7. Democratic Myopia and Future Generations: On Institutional Innovations, their Impact Potential, and the Challenges of their Institutionalization
  8. Networkers, Grazers, and Explorers: how sustainability-oriented innovation in SMEs unfolds through a regional network setting.
  9. Mathematical Modelling of molecular adsorption in zeolite coated frequency domain sensors
  10. The victimization of children as a social problem and representation
  11. Competition Law in Developing Countries
  12. Publikationsstrategien: Weblogs, AV-Inhalte, Open Access, Urheberrecht
  13. Local arts organization and network analysis: A case study in Germany
  14. The effect of professional development on teachers’ PCK, on beliefs and on the quality of teaching
  15. Photodegradation and aerobic biodegradability of angiotensin-converting enzyme inhibitor Captopril and identification of transformation products by LC MS/MS.
  16. Worldwide Summit on Corporate Universities and Academies
  17. “Pop Meets Science” 2008
  18. The apparent simplicity of children’s literature and its implications for foreign language teaching and learning (International AILA Literature in Language Learning and Teaching Network Conference, Universität Erfurt)

Publications

  1. Analysis of the construction of an autonomous robot to improve its energy efficiency when traveling through irregular terrain
  2. Study of Single Filament Dielectric Barrier Discharge in Argon
  3. Dealing with inclusion–teachers’ assessment of internal and external resources
  4. Applying the Rasch sampler to identify aberrant responding through person fit statistics under fixed nominal α-level.
  5. Analytic reproducibility in articles receiving open data badges at the journal Psychological Science
  6. Enhancement of workability in AZ31 alloy - Processing maps
  7. Question answering over linked data
  8. Plant density modifies root system architecture in spring barley (Hordeum vulgare L.) through a change in nodal root number
  9. Land use affects dung beetle communities and their ecosystem service in forests and grasslands
  10. On the Hausdorff dimension of fractals given by certain expansions of real numbers
  11. A scale-up procedure to dialkyl carbonates; evaluation of their properties, biodegradability, and toxicity
  12. Question Answering Mediated by Visual Clues and Knowledge Graphs
  13. Can Geodesign Be Used to Facilitate Boundary Management for Planning and Implementation of Nature-based Solutions?
  14. Productive Transformations and Bilateralism in the Semi-Periphery
  15. Generating dispatching rules for semiconductor manufacturing to minimize weighted tardiness
  16. Mobilität
  17. "If you like something, you want it to develop."
  18. Rapid ecosystem change challenges the adaptive capacity of local environmental knowledge
  19. The Bigger Picture of Corruption
  20. Sustainable development indicators
  21. Structuring multiple perspectives in environmental decision-making
  22. Insights into an Action-Oriented Training Program to Promote Sustainable Entrepreneurship
  23. Fear of Infection or Justification of Social Exclusion? The Symbolic Exploitation of the Ebola Epidemic
  24. Ergebnisse einer Sparkassen-Umfrage