Question answering over linked data: What is difficult to answer? What affects the F scores?

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

  • Muhammad Saleem
  • Samaneh Nazari Dastjerdi
  • Ricardo Usbeck
  • Axel Cyrille Ngonga Ngomo

We present a fine-grained analysis of the Question Answering over Linked Data (QALD-6) challenge. We divide the QALD-6 questions into 8 main categories and compare state-of-the-art questions answering (QA) systems over Linked Data against the individual categories. We show the difficulty (in terms of overall F scores of the QA systems) of each category. We show the effect of various natural language and SPARQL features such as the number of triple patterns, number of keywords, the answer size, the type of answers, the effect of aggregate functions, and the SPARQL query forms on the overall F scores of the QA systems.

OriginalspracheEnglisch
TitelJoint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3 : Natural Language Interfaces for the Web of Data
HerausgeberRcardo Usbeck, Axel-Cyrille Ngonga Ngomo, Jin-Dong Kim, Key-Sun Choi, Philipp Cimiano, Irini Fundulaki, Anastasia Krithara
Band1932
VerlagSun Site Central Europe (RWTH Aachen University)
Erscheinungsdatum2017
PublikationsstatusErschienen - 2017
Extern publiziertJa
VeranstaltungJoint BLINK 2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data, BLINK 2017-NLIWoD3 2017 - Vienna, Österreich
Dauer: 21.10.201722.10.2017
https://dblp.org/db/conf/semweb/blink2017.html

Bibliographische Notiz

Funding Information:
This work has been supported by the H2020 project HOBBIT (GA no. 688227) as well as the EuroStars projects DIESEL (no. 01QE1512C) and QAMEL (no. 01QE1549C). This work has also been supported by the German Federal Ministry of Transport and Digital Infrastructure (BMVI) in the projects LIMBO (no. 19F2029I) and OPAL (no. 19F2028A) as well as by the German Federal Ministry of Education and Research (BMBF) within ’KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ’Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456).

Links