8th challenge on question answering over linked data (QALD-8)

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

  • Ricardo Usbeck
  • Axel Cyrille Ngonga Ngomo
  • Felix Conrads
  • Michael Röder
  • Giulio Napolitano

The QALD-8 challenge focused on the successful and long running multilingual QA task. For the first time, the participating teams were required to provide webservices of their systems to participate in the challenge, which will in turn support comparable research in the future. In this challenge, we also changed the underlying evaluation platform to account for the need for comparable experiments via webservices in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account. Moreover, we will remove most of the curve ball questions to reflect the original character of the QALD challenge, which provides a clean and linguistically challenging benchmark.

OriginalspracheEnglisch
TitelSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
HerausgeberKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Anzahl der Seiten7
Band2241
VerlagSun Site Central Europe (RWTH Aachen University)
Erscheinungsdatum10.2018
Seiten51-57
PublikationsstatusErschienen - 10.2018
Extern publiziertJa
VeranstaltungJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, USA / Vereinigte Staaten
Dauer: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographische Notiz

Funding Information:
Acknowledgments. This work has been supported by the Federal Ministry of Transport and Digital Infrastructure (BMVI) in the LIMBO research project

Funding Information:
(grant no. 19F2029C) and the in the OPAL research project (grant no. 19F2028A) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). The authors gratefully acknowledge financial support from the German Federal Ministry of Education and Research within Eurostars, a joint programme of EUREKA and the European Community under the project E! 9367 DIESEL and E! 9725 QAMEL. We also want to thank Christina Unger and Sebastian Walter for supporting this challenge.

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Links

Zuletzt angesehen

Publikationen

  1. Deriving inferential statistics from recurrence plots
  2. Experience from downscaling IPCC-SRES scenarios to specific national-level focus scenarios for ecosystem service management
  3. Habitual Actions as a Challenge to the Standard Theory of Action
  4. Applied Conversation Analysis in Foreign Language Didactics
  5. Requests for mathematical reasoning in textbooks for primary-level students
  6. Mapping social values of ecosystem services: What is behind the map?
  7. Homogenization approach based on laminates
  8. The persistence of subsistence and the limits to development studies
  9. A Robust Approximated Derivative Action of a PID Regulator to be Applied in a Permanent Magnet Synchronous Motor Control
  10. Rebound Effects in Methods of Artificial Intelligence
  11. Is the market classification of risk always efficient?
  12. Third International Mathematics and Science Study and Trends in Mathematics and Science Studies (TIMSS)
  13. Development and characterisation of a new interface for coupling capillary LC with collision-cell ICPMS and its application for phosphorylation profiling of tryptic protein digests
  14. The significance of tree-tree interactions for forest ecosystem functioning
  15. Excellence in Teaching and Learning
  16. Is Calluna vulgaris a suitable bio-monitor of management-mediated nutrient pools in heathland ecosystems?
  17. Transformation products in the water cycle and the unsolved problem of their proactive assessment
  18. Knowledge Generation and Sustainable Development
  19. Bright Spots for Local WFD Implementation Through Collaboration with Nature Conservation Authorities?
  20. Assessing Exposure of Pesticides to Bees
  21. Web-Based Stress Management Program for University Students in Indonesia
  22. Multitrophic diversity in a biodiverse forest is highly nonlinear across spatial scales
  23. Effect of salinity-changing rates on filtration activity of mussels from two sites within the Baltic Mytilus hybrid zone
  24. Reprocessing from the inside
  25. ‘The Useful, the Bad and the Ugly’.
  26. Othering Space
  27. Science-Related Outcomes
  28. Skills and knowledge management in higher education
  29. Single-Word Recognition Need Not Depend on Single-Word Features
  30. Data quality assessment framework for critical raw materials. The case of cobalt
  31. Non-target Analysis and Chemometric Evaluation of a Passive Sampler Monitoring of Small Streams