QALD-10 — The 10th Challenge on Question Answering over Linked Data: Shifting from DBpedia to Wikidata as a KG for KGQA

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

  • Ricardo Usbeck
  • Xi Yan
  • Aleksandr Perevalov
  • Longquan Jiang
  • Julius Schulz
  • Angelie Kraft
  • Cedric Möller
  • Junbo Huang
  • Jan Reineke
  • Axel-Cyrille Ngonga Ngomo
  • Muhammad Saleem
  • Andreas Both
Knowledge Graph Question Answering (KGQA) has gained attention from both industry and academia over the past decade. Researchers proposed a substantial amount of benchmarking datasets with different properties, pushing the development in this field forward. Many of these benchmarks depend on Freebase, DBpedia, or Wikidata. However, KGQA benchmarks that depend on Freebase and DBpedia are gradually less studied and used, because Freebase is defunct and DBpedia lacks the structural validity of Wikidata. Therefore, research is gravitating toward Wikidata-based benchmarks. That is, new KGQA benchmarks are created on the basis of Wikidata and existing ones are migrated. We present a new, multilingual, complex KGQA benchmarking dataset as the 10th part of the Question Answering over Linked Data (QALD) benchmark series. This corpus formerly depended on DBpedia. Since QALD serves as a base for many machine-generated benchmarks, we increased the size and adjusted the benchmark to Wikidata and its ranking mechanism of properties. These measures foster novel KGQA developments by more demanding benchmarks. Creating a benchmark from scratch or migrating it from DBpedia to Wikidata is non-trivial due to the complexity of the Wikidata knowledge graph, mapping issues between different languages, and the ranking mechanism of properties using qualifiers. We present our creation strategy and the challenges we faced that will assist other researchers in their future work. Our case study, in the form of a conference challenge, is accompanied by an in-depth analysis of the created benchmark.
OriginalspracheEnglisch
ZeitschriftSemantic Web
Jahrgang15
Ausgabenummer6
Seiten (von - bis)2193-2207
Anzahl der Seiten14
ISSN1570-0844
DOIs
PublikationsstatusErschienen - 2023
Extern publiziertJa

Zuletzt angesehen

Aktivitäten

  1. Computersimulation und Super-GAU
  2. Investigation of the evolution and kinetics of temperature-driven intermetallic compound during solid-state joining of an Al-Mg alloy via the multiphase-field method
  3. Working Towards Decent Work on Online Platforms: Building and Maintaining an Institutional Infrastructure Based on the German Social Partnership Tradition
  4. How to make use of evidence based management in entrepreneurship: The example of Personal Initiative Training
  5. Lodz University of Technology
  6. An Optimal Polynomial Trajectory for Electromagnetic Actuators
  7. Objects between Craft, Science and Art: The Blaschka Models at Harvard
  8. Negotiating normativity: discourses of (non) belonging and (non) coincidences in the context of transnational adoption
  9. What we mean when we talk about freedom – The KOMFOR study: an analysis of students' choices of courses in interdisciplinary parts of the curriculum.
  10. Building Collective Institutional Infrastructures for Decent Platform Work: The Development of a Crowdwork Agreement in Germany
  11. Multi problem families”, “overburdened mothers”, and where is the child? Physical violence and symbolic power of definition
  12. Symposium: Unstable Monuments: Remnants from Times of Ideology
  13. Workshop: "Mit Leben Rechnen"
  14. Do program helpfulness ratings predict engagement in an online eating disorder intervention?
  15. Towards a Blackosmopolitical Proposal: Decolonization Perspectives through the Shift to Singular Knowledges
  16. Control and Freedom: On Interactivity as a Software effect
  17. Digitally-Enhanced TBLT in Synchronous Video-Based ELT: A Qualitative-Empirical Study on the Use of Task-Supported, Video- Based English Teaching (poster)

Publikationen

  1. Impact assessment of emissions stabilization scenarios with and without induced technological change
  2. Reference wages and turnover intentions
  3. Maintaining the impact of action-oriented entrepreneurship training
  4. The Crowd in Flux
  5. Effect of internal defects on tensile properties of A356 casting alloys
  6. The complexity of integrated flood management
  7. New developments in space technology
  8. Implicit processes in moral decision making: Why milliseconds matter
  9. Science-Related Outcomes
  10. An Adaptive Two-Stage Observer in the Control of a New Electromagnetic Valve Actuator for Camless Internal Combustion Engines
  11. Regulating Nimbus and Focus
  12. From estimation results to stylized facts
  13. Skills and knowledge management in higher education
  14. An InfoSpace Paradigm for Local and ad hoc Peer-to-Peer Communication
  15. Next level production networks
  16. A Unified Contextual Bandit Framework for Long- and Short-Term Recommendations
  17. Avoiding irreversible change
  18. Adjust for Windows – Version 1.1
  19. The Role of Zn Additions on the Microstructure and Mechanical Properties of Mg–Nd–Zn Alloys
  20. Collaborative decision making in sustainable flood risk management
  21. Nmap: A novel neighborhood preservation space-filling algorithm
  22. Schreibentwicklung in der Hochschule
  23. Image, Process, Performance, Machine
  24. Numerical responses of saproxylic beetles to rapid increases in dead wood availability following geometrid moth outbreaks in sub-arctic mountain birch forest
  25. Efficiency and usability of industrial laser assistance systems in composite preforming
  26. Study of hot forging behavior of as-cast Mg-3Al-1Zn-2Ca alloy towards optimization of its hot workability
  27. Revisiting Carbon Disclosure and Performance