9th challenge on question answering over linked data (QALD-9)

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

  • Ricardo Usbeck
  • Ria Hari Gusmita
  • Axel Cyrille Ngonga Ngomo
  • Muhammad Saleem

The QALD-9 challenge focused on the successful and long running multilingual QA task. In particular, we wanted to create an updated dataset which is larger than ever before and has a higher quality due to the employment of QUANT's semi-automatic curation measure. [2]. The teams were required to provide web-services of their systems to participate in the challenge, which will in turn support comparable research in the future in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account.

Original languageEnglish
Title of host publicationSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
EditorsKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Number of pages7
Volume2241
PublisherSun Site Central Europe (RWTH Aachen University)
Publication date10.2018
Pages58-64
Publication statusPublished - 10.2018
Externally publishedYes
EventJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, United States
Duration: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographical note

Funding Information:
Acknowledgements This work has been supported by the H2020 project HOBBIT (GA no. 688227) as well as by the BMVI projects LIMBO (project no. 19F2029C) and OPAL (project no. 19F20284) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). The authors gratefully acknowledge financial support from the German Federal Ministry of Education and Research within Eurostars, a joint programme of EUREKA and the European Community under the project E! 9367 DIESEL and E! 9725 QAMEL.

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Recently viewed

Activities

  1. Observing Videos of Teachers’ Own or Others’ Classrooms. What Do Teachers Learn When They Analyze Two Different Video Types?
  2. Workshop "Marked-based Instruments (MBI) for Ecosystem Services and Nature Protection" - 2011
  3. Conference on Cross-sectional Dependence in Panel Data Models - 2013
  4. Archive, Non-Archive, Counter-Archive
  5. International Conference on E-Health Networking, Application and Services 2017
  6. Preliminary results of a web-based and mobile stress-management intervention for employees
  7. How working from home impairs recovery from work: Anticipated availability as a cognitive process in the stressor-detachment model
  8. Learning Management Systems in EFL: Simulating the U.S. Presidential Election in a Transatlantic Blended Learning Project
  9. Exploring the potential role of priority effects for ecological restoration
  10. WK ORG Workshop - WK ORG 2019
  11. Science-Society Interfaces: Co-Organizing and Reporting of a Session at the 2nd Future Earth Summit
  12. Chronic pain patients' acceptance of internet-based interventions and how to influence it: a randomised controlled trial
  13. Inquiry-based Learning Environment to Welcome the Diversity of a Chemistry Class
  14. {Futures} loading...
  15. Modern micropolitics of antipopulism: Rethinking discourse and empathy
  16. 8th Organizations, Artifacts and Practices Workshop - OAP 2018
  17. Methods for Ph.D.
  18. 25th International Conference on System Theory, Control and Computing
  19. Investigation of the evolution and kinetics of temperature-driven intermetallic compound during solid-state joining of an Al-Mg alloy via the multiphase-field method
  20. Lodz University of Technology

Publications

  1. A transfer operator based numerical investigation of coherent structures in three-dimensional Southern ocean circulation
  2. A piezo servo hydraulic actuator for use in camless combustion engines and its control with MPC
  3. Editors’ Introduction
  4. Careless responding detection revisited
  5. IFIP WG 13.5 workshop on resilience, reliability, safety and human error in system development
  6. An Extended Kalman Filter as an Observer in a Control Structure for Health Monitoring of a Metal-Polymer Hybrid Soft Actuator
  7. Identification of Parameters and States in PMSMs
  8. Language Model Transformers as Evaluators for Open-domain Dialogues
  9. rSOESGOPE Method Applied to Four-Tank System Modeling
  10. Construal level theory
  11. Development and characterisation of a new interface for coupling capillary LC with collision-cell ICPMS and its application for phosphorylation profiling of tryptic protein digests
  12. Separable models for interconnected production-inventory systems
  13. Release of monomers from four different composite materials after halogen and LED curing
  14. Meat substitutes
  15. Identifying determinants of teachers' judgment (in)accuracy regarding students' school-related motivations using a Bayesian cross-classified multi-level model
  16. Young children spontaneously recreate core properties of language in a new modality
  17. Scaffolding, software and scenarios
  18. Transformation products in the water cycle and the unsolved problem of their proactive assessment
  19. Knowledge Generation and Sustainable Development
  20. Leaf Nutritional Content, Tree Richness, and Season Shape the Caterpillar Functional Trait Composition Hosted by Trees
  21. Sensorimotor Control and Proprioception in Neurorehabilitation
  22. Co-production of nature's contributions to people
  23. Interpersonal Physiological Synchrony Predicts Group Cohesion
  24. A Systematic Literature Review Of Machine Learning Approaches For The Prediction Of Delivery Dates
  25. Circular and inclusive utilization of alternative proteins
  26. Next generation wireless energy aware sensors for internet of things
  27. A flexible global warming index for use in an integrated approach to climate change assessment
  28. A cascade regulator using Lyapunov's PID-PID controllers for an aggregate actuator in automotive applications