9th challenge on question answering over linked data (QALD-9)

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

  • Ricardo Usbeck
  • Ria Hari Gusmita
  • Axel Cyrille Ngonga Ngomo
  • Muhammad Saleem

The QALD-9 challenge focused on the successful and long running multilingual QA task. In particular, we wanted to create an updated dataset which is larger than ever before and has a higher quality due to the employment of QUANT's semi-automatic curation measure. [2]. The teams were required to provide web-services of their systems to participate in the challenge, which will in turn support comparable research in the future in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account.

OriginalspracheEnglisch
TitelSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
HerausgeberKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Anzahl der Seiten7
Band2241
VerlagSun Site Central Europe (RWTH Aachen University)
Erscheinungsdatum10.2018
Seiten58-64
PublikationsstatusErschienen - 10.2018
Extern publiziertJa
VeranstaltungJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, USA / Vereinigte Staaten
Dauer: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographische Notiz

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Links

Zuletzt angesehen

Aktivitäten

  1. Association for Information Systems (AIS) (Externe Organisation)
  2. Adaptation of Coastal Protection to Climate Change: A Transdisciplinary Approach to Viable Strategies
  3. "Is your slam based on facts, or on gags and slapstick?”– How problems of contemporary science communication concepts become visible in new public genres like the science slam
  4. Vortrag: "Neapel"
  5. Konferenz “European Governance – More Than a Catchword ?" 2003
  6. Wie Roboter Einfluss auf unser Leben nehmen
  7. 6th Terra Ciritca: Critique and/as Technology
  8. Grand challenges, organized creativity and inter-organizational relationships
  9. International Class Actions Conference - 2019
  10. Arlene Raven and the Feminist Studio Workshop
  11. A Guided Self-help Intervention for College Women with Eating Disorders: Long-term Results from a Large Randomized Controlled Trial
  12. Learning Change: Studentische Reallabore für BNE nutzen
  13. What we mean when we talk about freedom – The KOMFOR study: an analysis of students' choices of courses in interdisciplinary parts of the curriculum.
  14. New ways of communication.
  15. „Pegida in Germany. Causes and Consequences“
  16. Right-wing spaces. The transnational dimensions of right-wing extremism
  17. How Family Entrepreneurs Create Opportunities: A System-Theoretical View
  18. European Conference on Information Systems 2023 (Veranstaltung)
  19. High resolution assessment and modelling of suspended sediment in an agricultural catchment
  20. Gender-related issues in Berlin’s Electronic Dance Music Scene
  21. Improving skills. Evidence from secondary analysis of international surveys 2012
  22. Das Inverted Classroom Model im Kontext kompetenzorientierter Hochschullehre - Peer Learning und Cognitive Mapping in der Weiterentwicklung der Vorlesung Zahlentheorie