Developing a sustainable platform for entity annotation benchmarks

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

The existing entity annotation systems that drive the extraction of RDF from unstructured data are hard to compare as their evaluation relies on different data sets and measures. We developed GERBIL, an evaluation framework for semantic entity annotation that provides developers, end users and researchers with easy-to-use interfaces for the agile, fine-grained and uniform evaluation of 9 annotation tools on 11 different data sets within 6 different experimental settings on 6 different measures. In this paper, we present the developed interfaces, data flows and data structures. Moreover, we show how GERBIL supports a better reproducibility and archiving of experimental results.

Original languageEnglish
Title of host publicationThe Semantic Web : ESWC 2015 Satellite Events - ESWC 2015 Satellite Events
EditorsAntoine Zimmermann, Serena Villata, John Breslin, Catherine Faron-Zucker, Fabien Gandon, Christophe Guéret
Number of pages7
PublisherSpringer International Publishing
Publication date01.01.2015
Pages190-196
ISBN (print)978-3-319-25638-2
ISBN (electronic)978-3-319-25639-9
DOIs
Publication statusPublished - 01.01.2015
Externally publishedYes
Event12th European Semantic Web Conference - ESWC 2015 - Portoroz, Slovenia
Duration: 31.05.201504.06.2015
Conference number: 12
https://2015.eswc-conferences.org/index.html
https://2015.eswc-conferences.org/call-challenges.html

Bibliographical note

Parts of this work were supported by the FP7 project GeoKnow (GA No. 318159) and the BMWi project SAKE (GA No. 01MD15006E).

Publisher Copyright:
© Springer International Publishing Switzerland 2015.

Recently viewed

Activities

  1. Thomas Weise
  2. Workshop on Family Migration Processes in a Comparative Perspective - 2018
  3. 27th International Conference on System Theory, Control and Computing - ICSTCC 2023
  4. Monkey Business: Who Pulls the Strings? 2013
  5. Concurrent Adaptive Tests for Formative Assessments in School Classes
  6. Empirical Research Methods on Legitimacy: Repertory Grid as the Interface between „Measuring“ and „Evaluating“
  7. (De)composing Public Value: New Evidence for Basic Structures
  8. Speaking about vision, talking in the name of so much more: A methodological framework for ventriloquial analyses in organization studies
  9. Explaining Healthcare System Change
  10. Knowledge Space(s) of Globalization – Musealizing Things, People and Spaces of Global Trade
  11. Digital Games Lab Lecture Series - 2018
  12. How does tree sapling diversity influence browsing intensity by deer across spatial scales?
  13. Vortrag: Teaching football skills with digitally supported learning processes in primary school
  14. Going Green: Digital project work as a transdisciplinary and transcultural task in the foreign language and STEM classrooms
  15. Trajectory-based Lagrangian approaches for the extraction and characterization of coherent structures in turbulent convection
  16. International Conference of Computational Methods in Engineering Science - Chair of Session III
  17. Liquidity, Flows, Circulation: The Cultural Logic of Environmentalization (2nd part) 2021
  18. Using Ethnographic Methods in Organizational Communication Research: Considering Materiality, Aesthetics and Embodiment
  19. Organizational Practices for the Aging Workforce: Validation of an English Version of the Later Life Workplace Index

Publications

  1. NNARX networks on didactic level system identification
  2. Preventive Diagnostics for cardiovascular diseases based on probabilistic methods and description logic
  3. Highly Efficient IPT Transmitter Circuit Based on a Novel Enhanced Class B Amplifier for Consumer Applications
  4. Retest effects in matrix test performance
  5. Implementation of formative assessment
  6. TRY plant trait database – enhanced coverage and open access
  7. Modern Baselines for SPARQL Semantic Parsing
  8. Performance of methods to select landscape metrics for modelling species richness
  9. Earnings Less Risk-Free Interest Charge (ERIC) and Stock Returns—A Value-Based Management Perspective on ERIC’s Relative and Incremental Information Content
  10. Automatic three-dimensional geometry and mesh generation of periodic representative volume elements for matrix-inclusion composites
  11. An empirically grounded ontology for analyzing IT-based interventions in business ecosystems
  12. Reducing mean tardiness in a flexible job shop containing AGVs with optimized combinations of sequencing and routing rules
  13. The relationship between audit committees, external auditors, and internal control systems
  14. Germination changes can restructure communities through priority effects
  15. German Utilities and distributed PV
  16. The Structure of Student Interest in Computers and Information Technology
  17. Exploring Leverages and Pitfalls of Context Collapse in Modern Communication
  18. General Patterns and Conclusions
  19. Mechanistic Realization of the Turtle Shell
  20. Reporting and Analysing the Environmental Impact of Language Models on the Example of Commonsense Question Answering with External Knowledge
  21. A Developmental Trend in the Structure of Time-Estimation Performance
  22. Explaining the (Non-) Adoption of Advanced Data Analytics in Auditing
  23. A cognitive mapping approach to understanding public objection to energy infrastructure
  24. How difficult is the adaptation of POS taggers?
  25. Online-scheduling using past and real-time data