Automating SPARQL Query Translations between DBpedia and Wikidata

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschung

Authors

This paper investigates whether state-of-the-art Large Language Models (LLMs) can automatically translate SPARQL between popular Knowledge Graph (KG) schemas. We focus on translations between the DBpedia and Wikidata KG, and later on DBLP and OpenAlex KG. This study addresses a notable gap in KG interoperability research by rigorously evaluating LLM performance on SPARQL-to-SPARQL translation. Two benchmarks are assembled, where the first align 100 DBpedia-Wikidata queries from QALD-9-Plus; the second contains 100 DBLP queries aligned to OpenAlex, testing generalizability beyond encyclopaedic KGs. Three open LLMs: Llama-3-8B, DeepSeek-R1-Distill-Llama-70B, and Mistral-Large-Instruct-2407 are selected based on their sizes and architectures and tested with zero-shot, few-shot, and two chain-of-thought variants. Outputs were compared with gold answers, and resulting errors were categorized. We find that the performance varies markedly across models and prompting strategies, and that translations for Wikidata to DBpedia work far better than translations for DBpedia to Wikidata.
OriginalspracheEnglisch
TitelSEMANTiCS Conference 2025
Erscheinungsdatum14.07.2025
PublikationsstatusErschienen - 14.07.2025

Bibliographische Notiz

18 pages, 2 figues. Paper accepted at SEMANTiCS 2025 conference happening on September 2025

Dokumente

  • 2507.10045v1

    802 KB, PDF-Dokument

Zuletzt angesehen