9th challenge on question answering over linked data (QALD-9)

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

  • Ricardo Usbeck
  • Ria Hari Gusmita
  • Axel Cyrille Ngonga Ngomo
  • Muhammad Saleem

The QALD-9 challenge focused on the successful and long running multilingual QA task. In particular, we wanted to create an updated dataset which is larger than ever before and has a higher quality due to the employment of QUANT's semi-automatic curation measure. [2]. The teams were required to provide web-services of their systems to participate in the challenge, which will in turn support comparable research in the future in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account.

Original languageEnglish
Title of host publicationSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
EditorsKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Number of pages7
Volume2241
PublisherSun Site Central Europe (RWTH Aachen University)
Publication date10.2018
Pages58-64
Publication statusPublished - 10.2018
Externally publishedYes
EventJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, United States
Duration: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographical note

Funding Information:
Acknowledgements This work has been supported by the H2020 project HOBBIT (GA no. 688227) as well as by the BMVI projects LIMBO (project no. 19F2029C) and OPAL (project no. 19F20284) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). The authors gratefully acknowledge financial support from the German Federal Ministry of Education and Research within Eurostars, a joint programme of EUREKA and the European Community under the project E! 9367 DIESEL and E! 9725 QAMEL.

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Recently viewed

Publications

  1. A transfer operator based numerical investigation of coherent structures in three-dimensional Southern ocean circulation
  2. A piezo servo hydraulic actuator for use in camless combustion engines and its control with MPC
  3. Local expansion concepts for detecting transport barriers in dynamical systems
  4. Robust and Optimal Control Designed for Autonomous Surface Vessel Prototypes
  5. Effect of grain size and structure, solid solution elements, precipitates and twinning on nanohardness of Mg-Re alloys
  6. Development of an Active Aging Index for the Organizational Level
  7. Rapid ecosystem change challenges the adaptive capacity of local environmental knowledge
  8. Practical critique: Bridging the gap between critical and practice oriented REDD+ research communities’
  9. Optimal grazing management rules in semi-arid rangelands with uncertain rainfall
  10. Organisation der Regulierungsverwaltung
  11. Geschäftsführung ohne Auftrag (§ 687)
  12. Steuerung nachhaltiger Entwicklung
  13. Darstellung der Referenzarbeit "Schmidt, Torben (2007) Gemeinsames Lernen mit Selbstlernsoftware im Englischunterricht"
  14. Aufgabenkultur in der Hauptschule
  15. Paul Nizon: Das erzählerische Werk
  16. Künstliche Feuchtflächen in Hochwasserrückhaltebecken – eine Chance für die Reduzierung von Pflanzenschutzmitteleinträgen in Gewässer
  17. Fundamental social motives measured across forty-two cultures in two waves
  18. Cultivation of the heterotrophic microalga Galdieria sulphuraria on food waste
  19. Wahrheit in Gestalt - Sprachbedingungen der Wissenschaft
  20. Personality Effects on Children’s Speech in Everyday Life
  21. The footprint of pesticide stress in communities-Species traits reveal community effects of toxicants
  22. Keine Kohle für die Kohle
  23. Entwicklung und Evaluation eines Metamodells zur Verbesserung der unternehmensweiten Entscheidungsorientierung mithilfe der Unternehmensarchitektur
  24. Posturale Kontrolle in statischen und dynamischen Messbedingungen - Evaluationen und Trainingsinterventionen.
  25. § 292 Haftung bei Herausgabepflicht
  26. Three shades of 'urban-digital citizenship'
  27. Geschichte auf Zeit
  28. Vielfalt in der Schuldenberatung