1. //
  2. Start
  3. //
  4. Publications
  5. //
  6. Question answering over linked data
  7. //

Question answering over linked data: What is difficult to answer? What affects the F scores?

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Authors

  • Muhammad Saleem
  • Samaneh Nazari Dastjerdi
  • Ricardo Usbeck
  • Axel Cyrille Ngonga Ngomo

We present a fine-grained analysis of the Question Answering over Linked Data (QALD-6) challenge. We divide the QALD-6 questions into 8 main categories and compare state-of-the-art questions answering (QA) systems over Linked Data against the individual categories. We show the difficulty (in terms of overall F scores of the QA systems) of each category. We show the effect of various natural language and SPARQL features such as the number of triple patterns, number of keywords, the answer size, the type of answers, the effect of aggregate functions, and the SPARQL query forms on the overall F scores of the QA systems.

Original languageEnglish
Title of host publicationJoint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3 : Natural Language Interfaces for the Web of Data
EditorsRcardo Usbeck, Axel-Cyrille Ngonga Ngomo, Jin-Dong Kim, Key-Sun Choi, Philipp Cimiano, Irini Fundulaki, Anastasia Krithara
Volume1932
PublisherSun Site Central Europe (RWTH Aachen University)
Publication date2017
Publication statusPublished - 2017
Externally publishedYes
EventJoint BLINK 2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data, BLINK 2017-NLIWoD3 2017 - Vienna, Austria
Duration: 21.10.2017 → 22.10.2017
https://dblp.org/db/conf/semweb/blink2017.html

Other publications by the same author(s)

ShortPathQA: A Dataset for Controllable Fusion of Large Language Models with Knowledge Graphs

Salnikov, M., Sakhovskiy, A., Nikishina, I., Usmanova, A., Kraft, A., Möller, C., Banerjee, D., Huang, J., Jiang, L., Abdullah, R., Yan, X., Tutubalina, E., Usbeck, R. & Panchenko, A., 2026, Natural Language Processing and Information Systems: 30th International Conference on Applications of Natural Language to Information Systems, NLDB 2025, Proceedings. Ichise, R. (ed.). Springer Science and Business Media Deutschland, p. 95-110 16 p. (Lecture Notes in Computer Science; vol. 15836 LNCS).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Analyzing the Influence of Knowledge Graph Information on Relation Extraction

Möller, C. & Usbeck, R., 2025, The Semantic Web: 22nd European Semantic Web Conference, ESWC 2025 Portoroz, Slovenia, June 1–5, 2025 Proceedings, Part I. Curry, E., Acosta, M., Poveda-Villalón, M., van Erp, M., Ojo, A., Hose, K., Shimizu, C. & Lisena, P. (eds.). Cham: Springer Nature Switzerland AG, Vol. 1. p. 460-480 21 p. (Lecture Notes in Computer Science ; vol. 15718).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Bridge-Generate: Scholarly Hybrid Question Answering

Taffa, T. A. & Usbeck, R., 23.05.2025, WWW Companion 2025 - Companion Proceedings of the ACM Web Conference 2025: Companion Proceedings of the ACM Web Conference 2025, April 28-May 2, 2025 Sydney, NSW, Australia. Long, G., Blumestein, M., Chang, Y., Lewin-Eytan, L., Huang, H. & Yom-Tov, E. (eds.). New York: Association for Computing Machinery, Inc, p. 1321-1325 5 p.

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Junior fellows and distinguished dissertation of the GI and AI for crisis

Usbeck, R., Kraft, A. & Westphal, P., 01.02.2025, In: IT - Information Technology. 67, 1, p. 1-2 2 p.

Research output: Journal contributions › Other (editorial matter etc.) › Research

Knowledge Graph Question Answering and Large Language Models

Banerjee, D., Hu, N., Tan, Y., Min, D., Wu, Y., Usbeck, R. & Qi, G., 17.03.2025, Handbook on Neurosymbolic AI and Knowledge Graphs. Hitzler, P., Dalal, A., Mahdavinejad, M. S. & Norouzi, S. S. (eds.). IOS Press BV, p. 466-531 66 p. ( Frontiers in Artificial Intelligence and Applications; vol. 400).

Research output: Contributions to collected editions/works › Chapter

Links

Recently viewed

Researchers

  1. Jonathan Pargätzi

Activities

  1. Supply Chain Management – Current Practices and Future Developments
  2. Democratic Myopia and Future Generations: On Institutional Innovations, their Impact Potential, and the Challenges of their Institutionalization
  3. Networkers, Grazers, and Explorers: how sustainability-oriented innovation in SMEs unfolds through a regional network setting.
  4. Mathematical Modelling of molecular adsorption in zeolite coated frequency domain sensors
  5. The victimization of children as a social problem and representation
  6. Competition Law in Developing Countries
  7. Publikationsstrategien: Weblogs, AV-Inhalte, Open Access, Urheberrecht
  8. Local arts organization and network analysis: A case study in Germany
  9. The effect of professional development on teachers’ PCK, on beliefs and on the quality of teaching
  10. Photodegradation and aerobic biodegradability of angiotensin-converting enzyme inhibitor Captopril and identification of transformation products by LC MS/MS.
  11. Worldwide Summit on Corporate Universities and Academies
  12. “Pop Meets Science” 2008
  13. The apparent simplicity of children’s literature and its implications for foreign language teaching and learning (International AILA Literature in Language Learning and Teaching Network Conference, Universität Erfurt)
  14. transcript Verlag (Verlag)
  15. 3rd International Conference on Implications of GM Crop Cultivation at Large Spatial Scales - GMLS-III 2012
  16. Ecological Indicators (Zeitschrift)

Publications

  1. Plant density modifies root system architecture in spring barley (Hordeum vulgare L.) through a change in nodal root number
  2. Land use affects dung beetle communities and their ecosystem service in forests and grasslands
  3. On the Hausdorff dimension of fractals given by certain expansions of real numbers
  4. A scale-up procedure to dialkyl carbonates; evaluation of their properties, biodegradability, and toxicity
  5. Question Answering Mediated by Visual Clues and Knowledge Graphs
  6. Can Geodesign Be Used to Facilitate Boundary Management for Planning and Implementation of Nature-based Solutions?
  7. Productive Transformations and Bilateralism in the Semi-Periphery
  8. Generating dispatching rules for semiconductor manufacturing to minimize weighted tardiness
  9. Mobilität
  10. "If you like something, you want it to develop."
  11. Rapid ecosystem change challenges the adaptive capacity of local environmental knowledge
  12. The Bigger Picture of Corruption
  13. Sustainable development indicators
  14. Structuring multiple perspectives in environmental decision-making
  15. Insights into an Action-Oriented Training Program to Promote Sustainable Entrepreneurship
  16. Fear of Infection or Justification of Social Exclusion? The Symbolic Exploitation of the Ebola Epidemic
  17. Ergebnisse einer Sparkassen-Umfrage
  18. Methoden-Muster: Partizipation und Verhandlung
  19. Introduction
  20. Benno Reifenberg (1892-1970)
  21. § 39
  22. Design of a Real Time Path of Motion Control for Manufacturing Applications
  23. Beyond carbon, more than forest? REDD plus governmentality in Indonesia
  24. Practice What You Preach?
  25. We have Some Calves left! Socially Accepted Alternatives to the Current Handling of Male Calves from Dairy Production