9th challenge on question answering over linked data (QALD-9)

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

  • Ricardo Usbeck
  • Ria Hari Gusmita
  • Axel Cyrille Ngonga Ngomo
  • Muhammad Saleem

The QALD-9 challenge focused on the successful and long running multilingual QA task. In particular, we wanted to create an updated dataset which is larger than ever before and has a higher quality due to the employment of QUANT's semi-automatic curation measure. [2]. The teams were required to provide web-services of their systems to participate in the challenge, which will in turn support comparable research in the future in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account.

OriginalspracheEnglisch
TitelSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
HerausgeberKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Anzahl der Seiten7
Band2241
VerlagSun Site Central Europe (RWTH Aachen University)
Erscheinungsdatum10.2018
Seiten58-64
PublikationsstatusErschienen - 10.2018
Extern publiziertJa
VeranstaltungJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, USA / Vereinigte Staaten
Dauer: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographische Notiz

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Links

Zuletzt angesehen

Forschende

  1. Julia Antoni

Publikationen

  1. Blueprint of a smokescreen
  2. Group consent in population based research
  3. Analyzing a transition to a sustainability-oriented science system in Germany
  4. How to do and communicate politics beyond routines
  5. Effect of ECAP Process on the Activation of Deformation Mechanisms During Subsequent Uniaxial Tension of Mg-ZEWK2000 Sheets
  6. New validated liquid chromatographic and chemometrics-assisted UV spectroscopic methods for the determination of two multicomponent cough mixtures in syrup.
  7. Comparing preference-based quality-of-life measures
  8. Inflation: Drivers and Dynamics 2020 CEBRA Annual Meeting Session Summary
  9. Experimental and Numerical Investigation of the Forming Zone in Dieless Wire Drawing Process of Thin Biometallic Wires
  10. Mechanisms of short-term soil carbon storage in experimental grasslands
  11. Vegetation responses to environmental conditions in floodplain grasslands
  12. Hot working parameters and mechanisms in as-cast Mg-3Sn-1Ca alloy
  13. Editorial
  14. Concern with COVID-19 pandemic threat and attitudes towards immigrants
  15. Competition response of European beech Fagus sylvatica L. varies with tree size and abiotic stress
  16. Attention on the source of influence reverses the impact of cross-contextual imitation
  17. Inadequate Assessment of the Ecosystem Service Rationale for Conservation
  18. Evolutionarily significant units in a flightless ground beetle show different climate niches and high extinction risk due to climate change
  19. Provocative Alloys
  20. Understanding Cross-Country Differences in Exporter Premia
  21. Das Echo des Propheten Jesaja
  22. „Das geht nicht in 45 Minuten“
  23. Impact of an acceptance facilitating intervention on diabetes patients' acceptance of Internet-based interventions for depression
  24. Mining User-Generated Financial Content to Predict Stock Price Movements
  25. NGOs
  26. Prenatal air pollution exposure and neonatal health
  27. Creativity in the classroom
  28. Co-productive agility and four collaborative pathways to sustainability transformations
  29. Einführung in die Philosophie des Mythos
  30. Flipper
  31. Friction analyses in twisted and helical profile extrusion of aluminum alloys