9th challenge on question answering over linked data (QALD-9)

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

  • Ricardo Usbeck
  • Ria Hari Gusmita
  • Axel Cyrille Ngonga Ngomo
  • Muhammad Saleem

The QALD-9 challenge focused on the successful and long running multilingual QA task. In particular, we wanted to create an updated dataset which is larger than ever before and has a higher quality due to the employment of QUANT's semi-automatic curation measure. [2]. The teams were required to provide web-services of their systems to participate in the challenge, which will in turn support comparable research in the future in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account.

Original languageEnglish
Title of host publicationSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
EditorsKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Number of pages7
Volume2241
PublisherSun Site Central Europe (RWTH Aachen University)
Publication date10.2018
Pages58-64
Publication statusPublished - 10.2018
Externally publishedYes
EventJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, United States
Duration: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographical note

Funding Information:
Acknowledgements This work has been supported by the H2020 project HOBBIT (GA no. 688227) as well as by the BMVI projects LIMBO (project no. 19F2029C) and OPAL (project no. 19F20284) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). The authors gratefully acknowledge financial support from the German Federal Ministry of Education and Research within Eurostars, a joint programme of EUREKA and the European Community under the project E! 9367 DIESEL and E! 9725 QAMEL.

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Recently viewed

Researchers

  1. Andreas Zedler

Publications

  1. Dynamic Capabilities in Sustainable Supply Chain Management
  2. Combining Model Predictive and Adaptive Control for an Atomic Force Microscope Piezo-Scanner-Cantilever System
  3. Cognitive load and science text comprehension
  4. Effect of grain size and structure, solid solution elements, precipitates and twinning on nanohardness of Mg-Re alloys
  5. Editors’ Introduction
  6. Planning for Sea Spaces I: Processes, Practices and Future Perspectives
  7. Where Tasks, Technology, and Textbooks Meet: An Exploratory Analysis of English Language Teachers’ Perceived Affordances of an Intelligent Language Tutoring System
  8. Towards a caring transdisciplinary research practice
  9. An assessment of the published results of animal relocations
  10. Species loss due to nutrient addition increases with spatial scale in global grasslands
  11. Entangled – But How?
  12. Categorizing urban tasks
  13. Added value of convection-permitting simulations for understanding future urban humidity extremes
  14. Disassembly and reassembly
  15. EEG frequency tagging evidence of intact social interaction recognition in adults with autism
  16. Light availability and land-use history drive biodiversity and functional changes in forest herb layer communities
  17. Rational Design of Molecules by Life Cycle Engineering
  18. Who commits virtual identity suicide? Differences in privacy concerns, internet addiction, and personality between facebook users and quitters
  19. Young children spontaneously recreate core properties of language in a new modality
  20. A Conceptual Structure of Justice - Providing a Tool to Analyse Conceptions of Justice
  21. Reference wages and turnover intentions
  22. Introduction
  23. The Crowd in Flux
  24. Consumers' Responses to CSR Activities
  25. Can Geodesign Be Used to Facilitate Boundary Management for Planning and Implementation of Nature-based Solutions?
  26. Effekte unterschiedlicher Kollaborationsskripte in chatbasiertem Computer-Supported Collaborative Learning am Beispiel von Lernprotokollen
  27. Implicit processes in moral decision making: Why milliseconds matter
  28. Dimensions of digital transformation in the context of modern agriculture
  29. Von „effective control“ zu „contactless control“?
  30. Understanding and managing post-acquisition integration as change process