8th challenge on question answering over linked data (QALD-8)

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

  • Ricardo Usbeck
  • Axel Cyrille Ngonga Ngomo
  • Felix Conrads
  • Michael Röder
  • Giulio Napolitano

The QALD-8 challenge focused on the successful and long running multilingual QA task. For the first time, the participating teams were required to provide webservices of their systems to participate in the challenge, which will in turn support comparable research in the future. In this challenge, we also changed the underlying evaluation platform to account for the need for comparable experiments via webservices in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account. Moreover, we will remove most of the curve ball questions to reflect the original character of the QALD challenge, which provides a clean and linguistically challenging benchmark.

OriginalspracheEnglisch
TitelSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
HerausgeberKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Anzahl der Seiten7
Band2241
VerlagSun Site Central Europe (RWTH Aachen University)
Erscheinungsdatum10.2018
Seiten51-57
PublikationsstatusErschienen - 10.2018
Extern publiziertJa
VeranstaltungJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, USA / Vereinigte Staaten
Dauer: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographische Notiz

Funding Information:
Acknowledgments. This work has been supported by the Federal Ministry of Transport and Digital Infrastructure (BMVI) in the LIMBO research project

Funding Information:
(grant no. 19F2029C) and the in the OPAL research project (grant no. 19F2028A) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). The authors gratefully acknowledge financial support from the German Federal Ministry of Education and Research within Eurostars, a joint programme of EUREKA and the European Community under the project E! 9367 DIESEL and E! 9725 QAMEL. We also want to thank Christina Unger and Sebastian Walter for supporting this challenge.

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Links

Zuletzt angesehen

Aktivitäten

  1. Are Self-Employed Time and Money Poor? Dynamics of Interpendent Multidimensional Poverty with German Time Use Diary Data
  2. Student Consumer Learning in Schools‘ „Cultures of Consumption“: Results of an Empirical Study
  3. Legitimizing Digital Transformation within an Incumbent: How Unaccepted Leaders Can Initiate Strategic Changes
  4. Automatic Detection and Classification of State Heads and Common People?
  5. The power and peril of precise numbers
  6. Measurement of Mental Models of Climate Change. Cross-Linked Thinking through Scenario Analysis
  7. Paper: The Multilevel Governance of Deportation – is Access to local Membership possible?
  8. Comparative Perspectives on Social Values and Modernization - 2011
  9. Karlstad Universität
  10. The Ethics of Memory - 2009
  11. Picasso and AI: analysing and questioning the technology that overwhelms us
  12. Who does take part in which kind of teacher professional development?
  13. Wien Depot: Podiumsdiskussion
  14. PhD Workshop on Theories in Information Systems Science
  15. Spas in the New Länder: A Transformation with an Uncertain Outcome.
  16. Interdisziplinarität in kuratorischen Netzwerken
  17. CHANGE Expertenworkshop 2008
  18. Education for Sustainable Development – Experiences from Theory and Practice
  19. Stimmtraining - 2009
  20. Towards a New Aesthetic Paradigm
  21. HyperKult XXIII – Bring your own... 2014
  22. Karlstad Universität
  23. Begriffliche Probleme lyrischer Subjektivität
  24. Conference "FICTION AND SIMULATION: Theories, Methods, Practices" - 2015
  25. Exploring organizational processes:A tension-based view
  26. Inherent constraints and the logic of 'There is no alternative': A political Anamnesis
  27. Non-expert AI Educators in Higher Education: How can OER support AI Teaching Practices?

Presse / Medien

  1. Performance unter Hypnose