Evaluating entity annotators using GERBIL

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

The need to bridge between the unstructured data on the Document Web and the structured data on the Web of Data has led to the development of a considerable number of annotation tools. However, these tools are hard to compare due to the diversity of data sets and measures used for evaluation. We will demonstrate GERBIL, an evaluation framework for semantic entity annotation that provides developers, end users and researchers with easy-to-use interfaces for the agile, finegrained and uniform evaluation of annotation tools on 11 different data sets within 6 different experimental settings on 6 different measures.

Original languageEnglish
Title of host publicationThe Semantic Web : ESWC 2015 Satellite Events - ESWC 2015 Satellite Events
EditorsAntoine Zimmermann, Serena Villata, John Breslin, Catherine Faron-Zucker, Fabien Gandon, Christophe Guéret
Number of pages6
PublisherSpringer International Publishing
Publication date01.01.2015
Pages159-164
ISBN (print)978-3-319-25638-2
ISBN (electronic)978-3-319-25639-9
DOIs
Publication statusPublished - 01.01.2015
Externally publishedYes
Event12th European Semantic Web Conference - ESWC 2015 - Portoroz, Slovenia
Duration: 31.05.201504.06.2015
Conference number: 12
https://2015.eswc-conferences.org/index.html
https://2015.eswc-conferences.org/call-challenges.html

Bibliographical note

Parts of this work were supported by the FP7 project GeoKnow (GA No. 318159) and the BMWi project SAKE (GA No. 01MD15006E).

Publisher Copyright:
© Springer International Publishing Switzerland 2015.

Recently viewed

Publications

  1. Real-time RDF extraction from unstructured data streams
  2. A Service-oriented Search framework for full text, geospatial and semantic search
  3. 7th open challenge on question answering over linked data (QALD-7)
  4. An expert-based reference list of variables for characterizing and monitoring social-ecological systems
  5. AGDISTIS - Graph-based disambiguation of named entities using linked data
  6. OKBQA framework towards an open collaboration for development of natural language question-answering systems over knowledge bases
  7. Holistic and scalable ranking of RDF data
  8. HAWK - hybrid question answering using linked data
  9. ASSESS — automatic self-assessment using linked data
  10. GENESIS - A generic RDF data access interface
  11. Treating dialogue quality evaluation as an anomaly detection problem
  12. Semantic Answer Type and Relation Prediction Task (SMART 2021)
  13. Towards an open question answering architecture
  14. Offline question answering over linked data using limited resources
  15. GERBIL - General entity annotator benchmarking framework
  16. Mathematical relation between extended connectivity and eigenvector coefficients.
  17. 8th challenge on question answering over linked data (QALD-8)
  18. Entity linking in 40 languages using MAG
  19. On the distinctiveness of tags in collaborative tagging systems
  20. Developing a sustainable platform for entity annotation benchmarks
  21. Proceedings of the 7th Natural Language Interfaces for the Web of Data (NLIWoD)
  22. German Utilities and distributed PV
  23. Enhancing Community Interactions with Data-Driven Chatbots - The DBpedia Chatbot
  24. German Utilities and Distributed PV
  25. Analyzing Talk and Text II: Thematic Analysis
  26. Canopy leaf traits, basal area, and age predict functional patterns of regenerating communities in secondary subtropical forests
  27. Investigating quality raters' performance using interface evaluation methods
  28. NIF4OGGD - NLP interchange format for open German governmental data
  29. CETUS – a baseline approach to type extraction
  30. Question answering over linked data
  31. Support from the Internet for Individuals with Mental Disorders