9th challenge on question answering over linked data (QALD-9)
Publikation: Beiträge in Sammelwerken › Aufsätze in Konferenzbänden › Forschung › begutachtet
Authors
The QALD-9 challenge focused on the successful and long running multilingual QA task. In particular, we wanted to create an updated dataset which is larger than ever before and has a higher quality due to the employment of QUANT's semi-automatic curation measure. [2]. The teams were required to provide web-services of their systems to participate in the challenge, which will in turn support comparable research in the future in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account.
Originalsprache | Englisch |
---|---|
Titel | SemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4 |
Herausgeber | Key-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck |
Anzahl der Seiten | 7 |
Band | 2241 |
Verlag | Sun Site Central Europe (RWTH Aachen University) |
Erscheinungsdatum | 10.2018 |
Seiten | 58-64 |
Publikationsstatus | Erschienen - 10.2018 |
Extern publiziert | Ja |
Veranstaltung | Joint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, USA / Vereinigte Staaten Dauer: 08.10.2018 → 09.10.2018 https://ceur-ws.org/Vol-2241/ https://ceur-ws.org/Vol-2241/JointPreface.pdf |
Bibliographische Notiz
Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.
- Informatik
- Wirtschaftsinformatik