9th challenge on question answering over linked data (QALD-9)

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

  • Ricardo Usbeck
  • Ria Hari Gusmita
  • Axel Cyrille Ngonga Ngomo
  • Muhammad Saleem

The QALD-9 challenge focused on the successful and long running multilingual QA task. In particular, we wanted to create an updated dataset which is larger than ever before and has a higher quality due to the employment of QUANT's semi-automatic curation measure. [2]. The teams were required to provide web-services of their systems to participate in the challenge, which will in turn support comparable research in the future in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account.

Original languageEnglish
Title of host publicationSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
EditorsKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Number of pages7
Volume2241
PublisherSun Site Central Europe (RWTH Aachen University)
Publication date10.2018
Pages58-64
Publication statusPublished - 10.2018
Externally publishedYes
EventJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, United States
Duration: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographical note

Funding Information:
Acknowledgements This work has been supported by the H2020 project HOBBIT (GA no. 688227) as well as by the BMVI projects LIMBO (project no. 19F2029C) and OPAL (project no. 19F20284) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). The authors gratefully acknowledge financial support from the German Federal Ministry of Education and Research within Eurostars, a joint programme of EUREKA and the European Community under the project E! 9367 DIESEL and E! 9725 QAMEL.

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Recently viewed

Researchers

  1. Matthias Schmidt

Publications

  1. Export entry, export exit, and productivity in German manufacturing industries
  2. Time-varying persistence in real oil prices and its determinant
  3. Development and application of green and sustainable analytical methods for flavonoid extraction from Passiflora waste
  4. Training in Components of Problem-Solving Competence
  5. Foundational Aspects of Polycentric Governance
  6. Cross-Fertilizing Qualitative Perspectives on Effects of a Mindfulness-Based Intervention: An Empirical Comparison of Four Methodical Approaches
  7. The adoption and implementation of Activity-based Costing
  8. Keep calm and follow the news
  9. Neighbour species richness and local structural variability modulate aboveground allocation patterns and crown morphology of individual trees
  10. A Fictional Risk Narrative and Its Potential for Social Resonance: Reception of Barbara Kingsolver’s Flight Behavior in Reviews and Reading Groups
  11. Analyzing Pragmatic Variation in English
  12. History of Embryology: Visualizations Through Series and Animation
  13. Effect of Welding Speed on Friction Stir Welds of PM2000 Alloy
  14. Learning Analytics and Digital Badges
  15. The sources of entrepreneurial activity, ed. by Gary D. Libecap
  16. Score-Informed Analysis of Tuning, Intonation, Pitch Modulation, and Dynamics in Jazz Solos
  17. Insights into PBDE Uptake, Body Burden, and Elimination Gained from Australian Age-Concentration Trends Observed Shortly after Peak Exposure
  18. Handwerk hacken
  19. Vocational identity trajectories
  20. Music Scenes and Cultural Ecosystems - Alternative Practices between 'Official Policy Recognition' and 'Post-Pandemic Austerity'
  21. Guest editorial
  22. Symbolic Environmental Legislation and Societal Self-Deception
  23. Die Entwicklung der Rechtschreibkompetenz beim Textschreiben
  24. Common opossum population density in an agroforestry system in Bolivia
  25. Analyzing non-linear dynamics of organic growth: evidence from small german new ventures
  26. Mathematiklehrerausbildung zum Studienbeginn
  27. Can radicals get a seat on the negotiation table? A Dynamic Perspective on Legitimation Processes.
  28. Health promoting schools in germany. Mapping the implementation of holistic strategies to tackle ncds and promote health
  29. Leveraging Architectural Thinking for Large-Scale E-Government Projects
  30. The counter-revolution is really televised …
  31. Heuristics-in-use
  32. Der Ekel als Privileg?
  33. Effectiveness and cost-effectiveness of a guided internet- and mobile-based depression intervention for individuals with chronic back pain
  34. Educating Change Agents for Sustainability