9th challenge on question answering over linked data (QALD-9)

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

  • Ricardo Usbeck
  • Ria Hari Gusmita
  • Axel Cyrille Ngonga Ngomo
  • Muhammad Saleem

The QALD-9 challenge focused on the successful and long running multilingual QA task. In particular, we wanted to create an updated dataset which is larger than ever before and has a higher quality due to the employment of QUANT's semi-automatic curation measure. [2]. The teams were required to provide web-services of their systems to participate in the challenge, which will in turn support comparable research in the future in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account.

Original languageEnglish
Title of host publicationSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
EditorsKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Number of pages7
Volume2241
PublisherSun Site Central Europe (RWTH Aachen University)
Publication date10.2018
Pages58-64
Publication statusPublished - 10.2018
Externally publishedYes
EventJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, United States
Duration: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographical note

Funding Information:
Acknowledgements This work has been supported by the H2020 project HOBBIT (GA no. 688227) as well as by the BMVI projects LIMBO (project no. 19F2029C) and OPAL (project no. 19F20284) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). The authors gratefully acknowledge financial support from the German Federal Ministry of Education and Research within Eurostars, a joint programme of EUREKA and the European Community under the project E! 9367 DIESEL and E! 9725 QAMEL.

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Recently viewed

Publications

  1. Acting in the Name of Others
  2. Learning Analytics and Digital Badges
  3. Take the money and run? Implementation and disclosure of environmentally-oriented crowdfunding projects
  4. Smart Devices Evaluation and Dynamic Cognitive Assistance System for Repair Processes in Production
  5. Future-proofing ecosystem restoration through enhancing adaptive capacity
  6. Second-Order Sliding Mode Control with State and Disturbance Estimation for a Permanent Magnet Linear Motor
  7. Operationalising the leverage points perspective for empirical research
  8. Differentiated Instruction Around the World - A Global Inclusive Insight
  9. Strategy execution in hospitals
  10. To use or not to use learning data
  11. Better performance of organic than conventional tomato varieties in single and mixed cropping
  12. Reconfiguring Desecuritization
  13. The language of situated joint activity: Social virtual reality and language learning in virtual exchange
  14. Introduction: Toward a business administration for the 21st century
  15. Experimental and numerical analysis of refill friction stir spot welding of thin AA7075-T6 sheets
  16. Like! You saved #energy today. Fostering Energy Efficiency in Buildings – The implementation of social media patterns as symbols in Building Management Systems‘ Graphical User Interfaces using Peirce’s semeiosis as a communication concept
  17. Application of novel constrained friction processing method to produce fine grained biomedical Mg-Zn-Ca alloy
  18. Allometric equations for maximum filtration rate in blue mussels Mytilus edulis and importance of condition index
  19. Export scope and characteristics of destination countries
  20. The effect of storage medium on the elution of monomers from composite materials
  21. "Wen feiern wir denn eigentlich?"
  22. Dispersal and diversity–unifying scale-dependent relationships within the neutral theory
  23. Carbon performance and disclosure
  24. Effect of salinity on growth of mussels, Mytilus edulis, with special reference to Great Belt (Denmark)