8th challenge on question answering over linked data (QALD-8)

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

  • Ricardo Usbeck
  • Axel Cyrille Ngonga Ngomo
  • Felix Conrads
  • Michael Röder
  • Giulio Napolitano

The QALD-8 challenge focused on the successful and long running multilingual QA task. For the first time, the participating teams were required to provide webservices of their systems to participate in the challenge, which will in turn support comparable research in the future. In this challenge, we also changed the underlying evaluation platform to account for the need for comparable experiments via webservices in contrast to former XML/JSON file submissions. This increased the entrance requirements for participating teams but ensures long term comparability of the system performance and a fair and open challenge. In the future, we will further simplify the participation process and offer leaderboards prior to the actual challenge to allow participants to see their performance beforehand. After feedback from the authors, we will likely add new key performance indicators for the capability of a system to know which questions it cannot answer and take confidence scores for answers into account. Moreover, we will remove most of the curve ball questions to reflect the original character of the QALD challenge, which provides a clean and linguistically challenging benchmark.

Original languageEnglish
Title of host publicationSemDeep-4_NLIWOD-4 2018 : Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4
EditorsKey-Sun Choi, Luis Espinosa Anke, Thierry Decklerck, Dagmar Gromann, Jin-Dong Kim, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Ricardo Usbeck
Number of pages7
Volume2241
PublisherSun Site Central Europe (RWTH Aachen University)
Publication date10.2018
Pages51-57
Publication statusPublished - 10.2018
Externally publishedYes
EventJoint 4th Workshop on Semantic Deep Learning: Natural Language Interfaces for the Web of Data and 9th Question Answering over Linked Data Challenge, SemDeep-4_NLIWOD-4 2018: co-located with the 17th International Semantic Web Conference - Monterey, United States
Duration: 08.10.201809.10.2018
https://ceur-ws.org/Vol-2241/
https://ceur-ws.org/Vol-2241/JointPreface.pdf

Bibliographical note

Publisher Copyright:
© 2018 CEUR-WS. All Rights Reserved.

Recently viewed

Researchers

  1. Zhiyong Xie

Publications

  1. Intellectual property issues in the use and distribution of remote sensing data
  2. Highly Efficient IPT Transmitter Circuit Based on a Novel Enhanced Class B Amplifier for Consumer Applications
  3. The model of educational reconstruction: A framework for the design of theory-based content specific interventions
  4. A cascade controller structure using an internal PID controller for a hybrid piezo-hydraulic actuator in camless internal combustion engines
  5. Species constancy depends on plot size - A problem for vegetation classification and how it can be solved
  6. Temporal dynamics of conflict monitoring and the effects of one or two conflict sources on error-(related) negativity
  7. Exploiting ConvNet diversity for flooding identification
  8. A latent state-trait analysis of current achievement motivation across different tasks of cognitive ability
  9. Hybrid models for future event prediction
  10. Supporting Visual and Verbal Learning Preferences in a Second-Language Multimedia Learning Environment
  11. Anomalous Results in G-Factor Models
  12. A blueprint for mapping and modelling ecosystem services
  13. The role of task complexity, modality and aptitude in narrative task performance
  14. Technical concept and evaluation design of the state subsidized project [Level-Q]
  15. Parametric finite element model and mechanical characterisation of electrospun materials for biomedical applications
  16. Intraspecific trait variation increases species diversity in a trait-based grassland model
  17. Predicting the Individual Mood Level based on Diary Data
  18. How do students and teachers deal with mathematical modelling problems?
  19. Influence of initial severity of depression on effectiveness of low intensity interventions
  20. Differences in the sophistication of Value-based Management
  21. Machine vision system errors for unmanned aerial vehicle navigation
  22. Detection of significant tracer gases by means of polymer gas sensors
  23. Improve a 3D distance measurement accuracy in stereo vision systems using optimization methods’ approach
  24. Visual-Inertial Navigation Systems and Technologies
  25. Defining the notion of mining, extraction and collection
  26. Adaptive capacity and learning to learn as leverage for social-ecological resilience
  27. 2. Advent
  28. Investigation and prediction of grain texture evolution in AA6082
  29. Adaptor device for transmitting e.g. blood pressure data of human body from blood pressure measuring device of data communication system to e.g. personal computer, has controller for controlling transmission of data to communication module
  30. Digital Business Transformation and the Changing Role of the IT Function
  31. The Economic Value of Clickstream Data From an Advertiser's Perspective
  32. Modeling and simulation of the microstructural behaviour in thermal sprayed coatings
  33. Instruments for research on transition. Applied methods and approaches for exploring the transition of young care leavers to adulthood
  34. Swarm Robotics, or: the smartness of 'a bunch of cheap dumb things'