QALD-10 — The 10th Challenge on Question Answering over Linked Data: Shifting from DBpedia to Wikidata as a KG for KGQA

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Ricardo Usbeck
  • Xi Yan
  • Aleksandr Perevalov
  • Longquan Jiang
  • Julius Schulz
  • Angelie Kraft
  • Cedric Möller
  • Junbo Huang
  • Jan Reineke
  • Axel-Cyrille Ngonga Ngomo
  • Muhammad Saleem
  • Andreas Both
Knowledge Graph Question Answering (KGQA) has gained attention from both industry and academia over the past decade. Researchers proposed a substantial amount of benchmarking datasets with different properties, pushing the development in this field forward. Many of these benchmarks depend on Freebase, DBpedia, or Wikidata. However, KGQA benchmarks that depend on Freebase and DBpedia are gradually less studied and used, because Freebase is defunct and DBpedia lacks the structural validity of Wikidata. Therefore, research is gravitating toward Wikidata-based benchmarks. That is, new KGQA benchmarks are created on the basis of Wikidata and existing ones are migrated. We present a new, multilingual, complex KGQA benchmarking dataset as the 10th part of the Question Answering over Linked Data (QALD) benchmark series. This corpus formerly depended on DBpedia. Since QALD serves as a base for many machine-generated benchmarks, we increased the size and adjusted the benchmark to Wikidata and its ranking mechanism of properties. These measures foster novel KGQA developments by more demanding benchmarks. Creating a benchmark from scratch or migrating it from DBpedia to Wikidata is non-trivial due to the complexity of the Wikidata knowledge graph, mapping issues between different languages, and the ranking mechanism of properties using qualifiers. We present our creation strategy and the challenges we faced that will assist other researchers in their future work. Our case study, in the form of a conference challenge, is accompanied by an in-depth analysis of the created benchmark.
Original languageEnglish
JournalSemantic Web
Volume15
Issue number6
Pages (from-to)2193-2207
Number of pages14
ISSN1570-0844
DOIs
Publication statusPublished - 2023
Externally publishedYes

Recently viewed

Researchers

  1. Marcus Erben

Publications

  1. Introduction
  2. An Adaptive Resonance Regulator for an Actuator using Periodic Signals in Camless Engine Systems
  3. Case study: The development of a multi-material heat sink by Additive Manufacturing using Aerosint technology
  4. Use of design methods, team leaders' goal orientation, and team effectiveness: A follow-up study in software development projects
  5. Applying the Rasch sampler to identify aberrant responding through person fit statistics under fixed nominal α-level.
  6. Extending Enterprise Architectures for Adopting the Internet of Things
  7. Measurement invariance in a grid-based measure of academic self-concept
  8. A direct test of the similarity assumption — Focusing on differences as compared with similarities decreases automatic imitation
  9. Empowered or informed? Seeking to mitigate gender differences in first-offer assertiveness through pre-negotiation interventions
  10. How to support students-learning in mathematical bridging-courses using ITS? Remedial Scenarios in the EU-Project Math-Bridge
  11. Priority effects of time of arrival of plant functional groups override sowing interval or density effects
  12. Beyond Structural Adjustment
  13. Identification of hybridization strategies for combining fused filament fabrication with unidirectional tape reinforcement
  14. Insights into adoption of farming practices through multiple lenses
  15. A Robust Approximated Derivative Action of a PID Regulator to be Applied in a Permanent Magnet Synchronous Motor Control
  16. Next level production networks
  17. Problem-Based and Project-Based Learning for Sustainable Development
  18. Multifractality Versus (Mono-) Fractality as Evidence of Nonlinear Interactions Across Timescales
  19. Improving mechanical properties of chip-based aluminum extrudates by integrated extrusion and equal channel angular pressing (iECAP)
  20. Multiple
  21. Instruments for research on transition. Applied methods and approaches for exploring the transition of young care leavers to adulthood
  22. Complex Trait-Treatment-Interaction analysis
  23. PI Control Applied to a Small-Scale Thermal System with Heating and Cooling Sources
  24. An Exploration of humans‘ ability to recognize emotions displayed by robots
  25. Sustainable development and learning for sustainability through a regional network project
  26. Integration of laboratory experiments into introductory electrical engineering courses