Question answering over linked data: What is difficult to answer? What affects the F scores?

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

  • Muhammad Saleem
  • Samaneh Nazari Dastjerdi
  • Ricardo Usbeck
  • Axel Cyrille Ngonga Ngomo

We present a fine-grained analysis of the Question Answering over Linked Data (QALD-6) challenge. We divide the QALD-6 questions into 8 main categories and compare state-of-the-art questions answering (QA) systems over Linked Data against the individual categories. We show the difficulty (in terms of overall F scores of the QA systems) of each category. We show the effect of various natural language and SPARQL features such as the number of triple patterns, number of keywords, the answer size, the type of answers, the effect of aggregate functions, and the SPARQL query forms on the overall F scores of the QA systems.

Original languageEnglish
Title of host publicationJoint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3 : Natural Language Interfaces for the Web of Data
EditorsRcardo Usbeck, Axel-Cyrille Ngonga Ngomo, Jin-Dong Kim, Key-Sun Choi, Philipp Cimiano, Irini Fundulaki, Anastasia Krithara
Volume1932
PublisherSun Site Central Europe (RWTH Aachen University)
Publication date2017
Publication statusPublished - 2017
Externally publishedYes
EventJoint BLINK 2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data, BLINK 2017-NLIWoD3 2017 - Vienna, Austria
Duration: 21.10.201722.10.2017
https://dblp.org/db/conf/semweb/blink2017.html