Evaluating entity annotators using GERBIL

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

The need to bridge between the unstructured data on the Document Web and the structured data on the Web of Data has led to the development of a considerable number of annotation tools. However, these tools are hard to compare due to the diversity of data sets and measures used for evaluation. We will demonstrate GERBIL, an evaluation framework for semantic entity annotation that provides developers, end users and researchers with easy-to-use interfaces for the agile, finegrained and uniform evaluation of annotation tools on 11 different data sets within 6 different experimental settings on 6 different measures.

Original languageEnglish
Title of host publicationThe Semantic Web : ESWC 2015 Satellite Events - ESWC 2015 Satellite Events
EditorsAntoine Zimmermann, Serena Villata, John Breslin, Catherine Faron-Zucker, Fabien Gandon, Christophe Guéret
Number of pages6
PublisherSpringer International Publishing
Publication date01.01.2015
Pages159-164
ISBN (print)978-3-319-25638-2
ISBN (electronic)978-3-319-25639-9
DOIs
Publication statusPublished - 01.01.2015
Externally publishedYes
Event12th European Semantic Web Conference - ESWC 2015 - Portoroz, Slovenia
Duration: 31.05.201504.06.2015
Conference number: 12
https://2015.eswc-conferences.org/index.html
https://2015.eswc-conferences.org/call-challenges.html

Bibliographical note

Parts of this work were supported by the FP7 project GeoKnow (GA No. 318159) and the BMWi project SAKE (GA No. 01MD15006E).

Publisher Copyright:
© Springer International Publishing Switzerland 2015.

Recently viewed

Researchers

  1. Marcus Erben

Publications

  1. Evaluating the construct validity of Objective Personality Tests using a multitrait-multimethod-Multioccasion-(MTMM-MO)-approach
  2. Constructions and Reconstructions. The Architectural Image between Rendering and Photography
  3. What does it mean to be sensitive for the complexity of (problem oriented) teaching?
  4. Development and validation of a method for the determination of trace alkylphenols and phthalates in the atmosphere
  5. Sensitivity to complexity - an important prerequisite of problem solving mathematics teaching
  6. From "cracking the orthographic code" to "playing with language"
  7. A Review of Latent Variable Modeling Using R - A Step-by-Step-Guide
  8. Binary Random Nets II
  9. The impact of linguistic complexity on the solution of mathematical modelling tasks
  10. Survey on challenges of Question Answering in the Semantic Web
  11. Visual Frames – Framing Visuals
  12. Dynamically adjusting the k-values of the ATCS rule in a flexible flow shop scenario with reinforcement learning
  13. Quality Assurance Methods and the Open Source Model
  14. Kalman Filter for Predictive Maintenance and Anomaly Detection
  15. Educational reconstruction as model for the theory-based design of student-centered learning environments in electrical engineering courses
  16. Developing a sustainable platform for entity annotation benchmarks
  17. Failing and the perception of failure in student-driven transdisciplinary projects
  18. What role for frames in scalar conflicts?
  19. An analytical approach to evaluating monotonic functions of fuzzy numbers
  20. Input-Output Linearization of a Thermoelectric Cooler for an Ice Clamping System Using a Dual Extended Kalman Filter
  21. Automatic three-dimensional geometry and mesh generation of periodic representative volume elements for matrix-inclusion composites
  22. Contextualizing certification and auditing
  23. Topic selection and development in learner-native speaker voice-based telecollaborative discourse
  24. Effects of an expressive writing intervention (EWI) with women treated for breast cancer explored with recurrence quantification analysis (RQA) of changes in text structure - a proof-of-concept study
  25. Conceptualizing protected area research in a transdisciplinary
  26. Multiobjective optimal control of fluid mixing
  27. Logistic Operating Curves in Theory and Practice
  28. Robust approximate fixed-time tracking control for uncertain robot manipulators
  29. Hydrograph analysis and basef low separation
  30. Deconstructing the Theoretical Language of Process Research
  31. An introductional lecture on chaotic systems through Lorenz attractor and forced Lotka Volterra equation for interdisciplinary education
  32. Introduction to the challenges and chances regarding the utilization of nitrogen-rich by-products and waste streams
  33. Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions
  34. Knowledge integration