1. //
  2. Start
  3. //
  4. Publications
  5. //
  6. Question answering over linked data
  7. //

Question answering over linked data: What is difficult to answer? What affects the F scores?

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Authors

  • Muhammad Saleem
  • Samaneh Nazari Dastjerdi
  • Ricardo Usbeck
  • Axel Cyrille Ngonga Ngomo

We present a fine-grained analysis of the Question Answering over Linked Data (QALD-6) challenge. We divide the QALD-6 questions into 8 main categories and compare state-of-the-art questions answering (QA) systems over Linked Data against the individual categories. We show the difficulty (in terms of overall F scores of the QA systems) of each category. We show the effect of various natural language and SPARQL features such as the number of triple patterns, number of keywords, the answer size, the type of answers, the effect of aggregate functions, and the SPARQL query forms on the overall F scores of the QA systems.

Original languageEnglish
Title of host publicationJoint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3 : Natural Language Interfaces for the Web of Data
EditorsRcardo Usbeck, Axel-Cyrille Ngonga Ngomo, Jin-Dong Kim, Key-Sun Choi, Philipp Cimiano, Irini Fundulaki, Anastasia Krithara
Volume1932
PublisherSun Site Central Europe (RWTH Aachen University)
Publication date2017
Publication statusPublished - 2017
Externally publishedYes
EventJoint BLINK 2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data, BLINK 2017-NLIWoD3 2017 - Vienna, Austria
Duration: 21.10.2017 → 22.10.2017
https://dblp.org/db/conf/semweb/blink2017.html

Other publications by the same author(s)

Analyzing the Influence of Knowledge Graph Information on Relation Extraction

Möller, C. & Usbeck, R., 2025, The Semantic Web: 22nd European Semantic Web Conference, ESWC 2025 Portoroz, Slovenia, June 1–5, 2025 Proceedings, Part I. Curry, E., Acosta, M., Poveda-Villalón, M., van Erp, M., Ojo, A., Hose, K., Shimizu, C. & Lisena, P. (eds.). Cham: Springer Nature Switzerland AG, Vol. 1. p. 460-480 21 p. (Lecture Notes in Computer Science ; vol. 15718).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Bridge-Generate: Scholarly Hybrid Question Answering

Taffa, T. A. & Usbeck, R., 2025, WWW Companion’25: Companion Proceedings of the ACM Web Conference 2025, April 28-May 2, 2025 Sydney, NSW, Australia. Long, G., Blumestein, M., Chang, Y., Lewin-Eytan, L., Huang, H. & Yom-Tov, E. (eds.). New York: Association for Computing Machinery, Inc, p. 1321-1325 5 p.

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Junior fellows and distinguished dissertation of the GI and AI for crisis

Usbeck, R., Kraft, A. & Westphal, P., 01.02.2025, In: IT - Information Technology. 67, 1, p. 1-2 2 p.

Research output: Journal contributions › Other (editorial matter etc.) › Research

Knowledge Graph Question Answering and Large Language Models

Banerjee, D., Hu, N., Tan, Y., Min, D., Wu, Y., Usbeck, R. & Qi, G., 17.03.2025, Handbook on Neurosymbolic AI and Knowledge Graphs. Hitzler, P., Dalal, A., Mahdavinejad, M. S. & Norouzi, S. S. (eds.). IOS Press BV, p. 466-531 66 p. ( Frontiers in Artificial Intelligence and Applications; vol. 400).

Research output: Contributions to collected editions/works › Chapter

Neuro-Symbolic Relation Extraction

Yan, X., Usmanova, A., Möller, C., Westphal, P. & Usbeck, R., 17.03.2025, Handbook on Neurosymbolic AI and Knowledge Graphs. Hitzler, P., Dalal, A., Mahdavinejad, M. S. & Norouzi, S. S. (eds.). IOS Press BV, p. 550-576 27 p. ( Frontiers in Artificial Intelligence and Applications; vol. 400).

Research output: Contributions to collected editions/works › Chapter

Links

Recently viewed

Activities

  1. Does participatory governance help address long-term environmental problems? Conceptual framework and empirical evidence from public decision-making processes in 23 democracies
  2. The link between supervisory board reporting and firm performance in Germany and Austria
  3. Comparative Perspectives on Social Values and Modernization - 2011
  4. Does resin represent a neglected component of bee ecology? A comparison between Old and New World bees.
  5. Redistribution preferences in motion: the effect of average preferences for redistribution in countries of origin on the preferences of immigrants. A cross-sectional approach
  6. Presentation: Nexus of Housing and Migration
  7. Life cycle thinking and systems thinking - how to support systems thinking in material flow management
  8. Hyperkult XXV - 2015
  9. Rational Design of Molecules by Life Cycle Engineering.
  10. Crazy, Classified City Life - Hackfeminist Future-Making Practices between Dystopia and Utopia, Predictability and Possibility
  11. Projektabschlusspräsentation
  12. Traces of varying task formulations within the texts of students
  13. What remains to be done to achieve open, global science
  14. Linking EFL Tasks to the World Outside: Promoting Community-Based Learning and Learner Agency through Blended-Learning Projects
  15. CyberKant, a Timely Response to the Eclipse of Reason by Mechanical Rationality - 2020
  16. Inside Wounds
  17. CHANGE Expertenworkshop 2008
  18. Symposium - New Old Properties
  19. Karlstad Universität

Publications

  1. Integrating methods for ecosystem service assessment
  2. Integrating Common Ground and Informativeness in Pragmatic Word Learning
  3. Analytics and Intuition in the Process of Selecting Talent
  4. Efficacy of a web-based intervention with and without guidance for employees with risky drinking
  5. Study of Single Filament Dielectric Barrier Discharge in Argon
  6. Influence of three different unstable shoe constructions on EMG-activity during treadmill walking
  7. Using rating scales for the assessment of physical self-concept
  8. Discourse, practice, policy and organizing
  9. Action Errors, Error Management, and Learning in Organizations
  10. FaQuAD
  11. Recurring patterns and blueprints of industrial symbioses as structural units for an it tool
  12. Principled Interpolation in Normalizing Flows
  13. Facing Up to Third Party Liability for Space Activities
  14. Learning with summaries
  15. Optimization of a gaseous multitube detector for soft X-ray detection
  16. Simon Denny
  17. Comparison of Backpropagation and Kalman Filter-based Training for Neural Networks
  18. Extraterritorial Asylum Processing. The Libya-Niger Emergency Transit Mechanism
  19. Assessing empirical research on value-based management
  20. Towards a Comprehensive Framework for Environmental Management Accounting
  21. Early-Career Researchers’ Perceptions of the Prevalence of Questionable Research Practices, Potential Causes, and Open Science
  22. Is Code Law? Kritik in Zeiten algorithmischer Gouvernementalität
  23. ℓp-norm multiple kernel learning
  24. How much can we learn about voluntary climate action from behavior in public goods games?
  25. Disentangling trade-offs and synergies around ecosystem services with the influence network framework
  26. Using Daily Stretching to Counteract Performance Decreases as a Result of Reduced Physical Activity—A Controlled Trial
  27. Halb voll oder halb leer?
  28. When Testing Becomes Learning—Underscoring the Relevance of Habituation to Improve Internal Validity of Common Neurocognitive Tests