8th challenge on question answering over linked data (QALD-8)

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

  • Ricardo Usbeck
  • Axel Cyrille Ngonga Ngomo
  • Felix Conrads
  • Michael Röder
  • Giulio Napolitano

The QALD-8 challenge focused on the successful and long running multilingual QA task. For the first time, the participating teams were required to provide webservices of their systems to participate in the challenge, which will in turn support comparable research in the future. In this challenge, we also changed the underlying evaluation platform to account for the need for comparable experiments via webservices in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account. Moreover, we will remove most of the curve ball questions to reflect the original character of the QALD challenge, which provides a clean and linguistically challenging benchmark.

OriginalspracheEnglisch
TitelSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
HerausgeberKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Anzahl der Seiten7
Band2241
VerlagSun Site Central Europe (RWTH Aachen University)
Erscheinungsdatum10.2018
Seiten51-57
PublikationsstatusErschienen - 10.2018
Extern publiziertJa
VeranstaltungJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, USA / Vereinigte Staaten
Dauer: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographische Notiz

Funding Information:
Acknowledgments. This work has been supported by the Federal Ministry of Transport and Digital Infrastructure (BMVI) in the LIMBO research project

Funding Information:
(grant no. 19F2029C) and the in the OPAL research project (grant no. 19F2028A) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). The authors gratefully acknowledge financial support from the German Federal Ministry of Education and Research within Eurostars, a joint programme of EUREKA and the European Community under the project E! 9367 DIESEL and E! 9725 QAMEL. We also want to thank Christina Unger and Sebastian Walter for supporting this challenge.

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Links

Zuletzt angesehen

Publikationen

  1. Detection of oscillations with application in the pantograph control
  2. Multi-Professional Support
  3. Use of design methods, team leaders' goal orientation, and team effectiveness: A follow-up study in software development projects
  4. Foreword to applied data science, demo, and nectar tracks
  5. Multiple
  6. Performance of methods to select landscape metrics for modelling species richness
  7. “Circuits of Commons”: Exploring the Connections Between Economic Lives and the Commons
  8. FaQuAD
  9. Recurring patterns and blueprints of industrial symbioses as structural units for an it tool
  10. Simon Denny
  11. Disentangling trade-offs and synergies around ecosystem services with the influence network framework
  12. New developments in extrusion of profiles with variable curvatures and cross-sections
  13. Development and application of a simplified sampling method for volatile polyfluorinated alkyl substances in indoor and environmental air
  14. Robust Decoupling Control of Contact Forces in Robotic Manipulation
  15. Pathways and mechanisms for catalyzing social impact through Orchestration: Insights from an open social innovation project
  16. Hands in Focus: Sign Language Recognition Via Top-Down Attention
  17. Biodiversity and ecosystem functioning relations in European forests depend on environmental context.
  18. Embracing scale-dependence to achieve a deeper understanding of biodiversity and its change across communities
  19. Combination of a reduced order state observer and an Extended Kalman Filter for Peltier cells
  20. Numerical Investigation of the Effect of Rolling on the Localized Stress and Strain Induction for Wire + Arc Additive Manufactured Structures
  21. Do we fail to exert self-control because we lack resources or motivation? Competing theories to explain a debated phenomenon
  22. What do people do when they use the internet?
  23. Machine Learning and Data Mining for Sports Analytics
  24. Collaborative modelling for active involvement of stakeholders in urban flood risk management
  25. Environmental Shareholder Value Matrix
  26. Online-Beratung für Eltern
  27. Navigating tensions in inclusive conservation
  28. Exploring the potential of using priority effects during ecological restoration to resist biological invasions in the neotropics
  29. Backward Extended Kalman Filter to Estimate and Adaptively Control a PMSM in Saturation Conditions