QALD-10 — The 10th Challenge on Question Answering over Linked Data

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Ricardo Usbeck
  • Xi Yan
  • Aleksandr Perevalov
  • Longquan Jiang
  • Julius Schulz
  • Angelie Kraft
  • Cedric Möller
  • Junbo Huang
  • Jan Reineke
  • Axel-Cyrille Ngonga Ngomo
  • Muhammad Saleem
  • Andreas Both
Knowledge Graph Question Answering (KGQA) has gained attention from both industry and academia over the past decade. Researchers proposed a substantial amount of benchmarking datasets with different properties, pushing the development in this field forward. Many of these benchmarks depend on Freebase, DBpedia, or Wikidata. However, KGQA benchmarks that depend on Freebase and DBpedia are gradually less studied and used, because Freebase is defunct and DBpedia lacks the structural validity of Wikidata. Therefore, research is gravitating toward Wikidata-based benchmarks. That is, new KGQA benchmarks are created on the basis of Wikidata and existing ones are migrated. We present a new, multilingual, complex KGQA benchmarking dataset as the 10th part of the Question Answering over Linked Data (QALD) benchmark series. This corpus formerly depended on DBpedia. Since QALD serves as a base for many machine-generated benchmarks, we increased the size and adjusted the benchmark to Wikidata and its ranking mechanism of properties. These measures foster novel KGQA developments by more demanding benchmarks. Creating a benchmark from scratch or migrating it from DBpedia to Wikidata is non-trivial due to the complexity of the Wikidata knowledge graph, mapping issues between different languages, and the ranking mechanism of properties using qualifiers. We present our creation strategy and the challenges we faced that will assist other researchers in their future work. Our case study, in the form of a conference challenge, is accompanied by an in-depth analysis of the created benchmark.
Original languageEnglish
JournalSemantic Web
Volume2024
Number of pages14
ISSN1570-0844
Publication statusAccepted/In press - 08.02.2023
Externally publishedYes

Recently viewed

Publications

  1. Die Wahlrechtssysteme in Mittel- und Osteuropa, Gerrit Manssen ...(Hrsg.)
  2. Hydrolyzed organic residues as sources of secondary raw materials
  3. The Company Congress As an Innovative Management Development Tool
  4. Editorial: Innovation und Forschung in der Arbeits(zeit)organisation.
  5. Commodity Chains, Rural Development and the Global Agri-food System
  6. Karl May und die Literaturwissenschaft: ein Thema für Außenseiter?
  7. Religious activity, risk-taking preferences and financial behaviour
  8. Bildungswachstum und äußere Schulreform im 19. und 20. Jahrhundert
  9. Außervertragliche Haftung der EG, Verhältnis zum nationalen Recht
  10. Mathematics in Robot Control for Theoretical and Applied Problems
  11. Rotkohlsaftindikator und Kristalldeo – eine unerklärliche Reaktion?
  12. Antecedents of Business Opportunity Identification and Innovation
  13. Kriminalisierung und Versicherheitlichung von Migration. Editorial
  14. Handball im Sportunterricht: Praxiskonzept für die Sekundarstufe I
  15. Controlling the Time Synchronicity of Convergent Supply Processes
  16. Collaborative epistemic writing and writing-to-learn in mathematics
  17. Do workers perceive high wage settlements of craft unions as fair?
  18. Vertrag über die Europäische Union (EUV) : Artikel 11 [Ziele der GASP]
  19. Transformer with Tree-order Encoding for Neural Program Generation
  20. History of Embryology: Visualizations Through Series and Animation
  21. The Role of Accountants in Controlling Sustainability Information
  22. Investigation and prediction of grain texture evolution in AA6082
  23. Model based logistic monitoring for supply and assembly processes
  24. Mathematik im Übergang Schule/Hochschule und im ersten Studienjahr
  25. Implementation of a balanced scorecard for hybrid business models
  26. Interaktives Fremdsprachenlernen: Potenziale und Herausforderungen
  27. Koordination von Supply Chains durch Mengenbindungsvereinbarungen
  28. Von der Produktion einer Wissenssendung bis zur Gruppendiskussion