8th challenge on question answering over linked data (QALD-8)

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

  • Ricardo Usbeck
  • Axel Cyrille Ngonga Ngomo
  • Felix Conrads
  • Michael Röder
  • Giulio Napolitano

The QALD-8 challenge focused on the successful and long running multilingual QA task. For the first time, the participating teams were required to provide webservices of their systems to participate in the challenge, which will in turn support comparable research in the future. In this challenge, we also changed the underlying evaluation platform to account for the need for comparable experiments via webservices in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account. Moreover, we will remove most of the curve ball questions to reflect the original character of the QALD challenge, which provides a clean and linguistically challenging benchmark.

OriginalspracheEnglisch
TitelSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
HerausgeberKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Anzahl der Seiten7
Band2241
VerlagSun Site Central Europe (RWTH Aachen University)
Erscheinungsdatum10.2018
Seiten51-57
PublikationsstatusErschienen - 10.2018
Extern publiziertJa
VeranstaltungJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, USA / Vereinigte Staaten
Dauer: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographische Notiz

Funding Information:
Acknowledgments. This work has been supported by the Federal Ministry of Transport and Digital Infrastructure (BMVI) in the LIMBO research project

Funding Information:
(grant no. 19F2029C) and the in the OPAL research project (grant no. 19F2028A) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). The authors gratefully acknowledge financial support from the German Federal Ministry of Education and Research within Eurostars, a joint programme of EUREKA and the European Community under the project E! 9367 DIESEL and E! 9725 QAMEL. We also want to thank Christina Unger and Sebastian Walter for supporting this challenge.

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Links

Zuletzt angesehen

Aktivitäten

  1. Co-creating transformative processes - a designerly approach
  2. Institute for Advanced Study Princeton
  3. Differentiating forest types using Terrasar-X spotlight images based on factor analysis
  4. How does tree sapling diversity influence browsing intensity by deer across spatial scales?
  5. Inter-university Consortium for Political and Social Research Summer Program in Quantitative Methods - 2019
  6. Breaks and age related strain in continuous physical work
  7. Are Self-Employed Time and Money Poor? Dynamics of Interpendent Multidimensional Poverty with German Time Use Diary Data
  8. Istron-Tagung 2008
  9. IMISCOE (Verlag)
  10. Internes Anti-Rassismus-Training
  11. HOW SUSTAINABILITY ACCOUNTING CONTRIBUTES TO IMPROVED INFORMATION MANAGEMENT AND MANAGEMENT CONTROL
  12. The relationship between intragenerational and intergenerational justice in the use of ecosystems and their services. An ecological-economic mode.
  13. Sonic Spaces and Playfulness
  14. The relationship between intragenerational and intergenerational justice in the use of ecosystems and their services
  15. Investigating the relationship between teachers' acceptance and use of educational technology and student data
  16. Processes of Sustainability Transformation. An inter- and transdisciplinary project
  17. Empathic Healthcare Chatbots: Comparing the Effects of Emotional Expression and Caring Behavior
  18. Kunstuniversität Linz
  19. Aesthetics of complexity, artists and resilient communities in urban anthropo-scenes
  20. From the Environmental State to the Sustainability State? Conceptualization, Indicators, and Examples
  21. 2nd Interdisciplinary Insights on Fraud and Corruption - I2FC 2014
  22. Universität von St. Andrews
  23. Der "als-ob" Modus: Polizei, Protest, Staatlichkeit