Standard
Leveraging LLMs in Scholarly Knowledge Graph Question Answering. / Taffa, Tilahun Abedissa; Usbeck, Ricardo.
Joint Proceedings of Scholarly QALD 2023 and SemREC 2023 co-located with 22nd International Semantic Web Conference ISWC 2023, Athens, Greece, November 6-10, 2023. Hrsg. / Debayan Banerjee; Ricardo Usbeck; Nandana Mihindukulasooriya; Gunjan Singh; Raghava Mutharaju; Pavan Kapanipathi. Band 3592 CEUR-WS.org, 2023. (CEUR Workshop Proceedings; Band 3592).
Publikation: Beiträge in Sammelwerken › Aufsätze in Konferenzbänden › Forschung › begutachtet
Harvard
Taffa, TA & Usbeck, R 2023,
Leveraging LLMs in Scholarly Knowledge Graph Question Answering. in D Banerjee, R Usbeck, N Mihindukulasooriya, G Singh, R Mutharaju & P Kapanipathi (Hrsg.),
Joint Proceedings of Scholarly QALD 2023 and SemREC 2023 co-located with 22nd International Semantic Web Conference ISWC 2023, Athens, Greece, November 6-10, 2023. Bd. 3592, CEUR Workshop Proceedings, Bd. 3592, CEUR-WS.org, Scholarly QALD 2023, Athen, Griechenland,
06.11.23.
https://doi.org/10.48550/ARXIV.2311.09841
APA
Taffa, T. A., & Usbeck, R. (2023).
Leveraging LLMs in Scholarly Knowledge Graph Question Answering. in D. Banerjee, R. Usbeck, N. Mihindukulasooriya, G. Singh, R. Mutharaju, & P. Kapanipathi (Hrsg.),
Joint Proceedings of Scholarly QALD 2023 and SemREC 2023 co-located with 22nd International Semantic Web Conference ISWC 2023, Athens, Greece, November 6-10, 2023 (Band 3592). (CEUR Workshop Proceedings; Band 3592). CEUR-WS.org.
https://doi.org/10.48550/ARXIV.2311.09841
Vancouver
Taffa TA, Usbeck R.
Leveraging LLMs in Scholarly Knowledge Graph Question Answering. in Banerjee D, Usbeck R, Mihindukulasooriya N, Singh G, Mutharaju R, Kapanipathi P, Hrsg., Joint Proceedings of Scholarly QALD 2023 and SemREC 2023 co-located with 22nd International Semantic Web Conference ISWC 2023, Athens, Greece, November 6-10, 2023. Band 3592. CEUR-WS.org. 2023. (CEUR Workshop Proceedings). doi: 10.48550/ARXIV.2311.09841
Bibtex
@inbook{f48b7be4dc1341e79d316fdb09e575dc,
title = "Leveraging LLMs in Scholarly Knowledge Graph Question Answering",
abstract = "This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner. The model initially identifies the top-n similar training questions related to a given test question via a BERT-based sentence encoder and retrieves their corresponding SPARQL. Using the top-n similar question-SPARQL pairs as an example and the test question creates a prompt. Then pass the prompt to the LLM and generate a SPARQL. Finally, runs the SPARQL against the underlying KG - ORKG (Open Research KG) endpoint and returns an answer. Our system achieves an F1 score of 99.0%, on SciQA - one of the Scholarly-QALD-23 challenge benchmarks. ",
keywords = "Informatics, Knowledge Graph Question Answering (KGQA), pen Research Knowledge Graph, arge Language Model, Scholarly KGQA, Scholarly-QALD, RKG, SciQA",
author = "Taffa, {Tilahun Abedissa} and Ricardo Usbeck",
note = "Funding Information: This work has been partially supported by grants for the DFG project NFDI4DataScience project ?DFG project no. 460234259) and by the Federal Ministry for Economics and Climate Action in the project CoyPu ?project number 01MK21007G). Publisher Copyright: {\textcopyright} 2023 CEUR-WS. All rights reserved.; Scholarly QALD 2023 ; Conference date: 06-11-2023 Through 10-11-2023",
year = "2023",
doi = "10.48550/ARXIV.2311.09841",
language = "English",
volume = "3592",
series = "CEUR Workshop Proceedings",
publisher = "CEUR-WS.org",
editor = "Debayan Banerjee and Ricardo Usbeck and Nandana Mihindukulasooriya and Gunjan Singh and Raghava Mutharaju and Pavan Kapanipathi",
booktitle = "Joint Proceedings of Scholarly QALD 2023 and SemREC 2023 co-located with 22nd International Semantic Web Conference ISWC 2023, Athens, Greece, November 6-10, 2023",
address = "Germany",
url = "https://ceur-ws.org/Vol-3592/",
}
RIS
TY - CHAP
T1 - Leveraging LLMs in Scholarly Knowledge Graph Question Answering
AU - Taffa, Tilahun Abedissa
AU - Usbeck, Ricardo
N1 - Conference code: 1
PY - 2023
Y1 - 2023
N2 - This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner. The model initially identifies the top-n similar training questions related to a given test question via a BERT-based sentence encoder and retrieves their corresponding SPARQL. Using the top-n similar question-SPARQL pairs as an example and the test question creates a prompt. Then pass the prompt to the LLM and generate a SPARQL. Finally, runs the SPARQL against the underlying KG - ORKG (Open Research KG) endpoint and returns an answer. Our system achieves an F1 score of 99.0%, on SciQA - one of the Scholarly-QALD-23 challenge benchmarks.
AB - This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner. The model initially identifies the top-n similar training questions related to a given test question via a BERT-based sentence encoder and retrieves their corresponding SPARQL. Using the top-n similar question-SPARQL pairs as an example and the test question creates a prompt. Then pass the prompt to the LLM and generate a SPARQL. Finally, runs the SPARQL against the underlying KG - ORKG (Open Research KG) endpoint and returns an answer. Our system achieves an F1 score of 99.0%, on SciQA - one of the Scholarly-QALD-23 challenge benchmarks.
KW - Informatics
KW - Knowledge Graph Question Answering (KGQA)
KW - pen Research Knowledge Graph
KW - arge Language Model
KW - Scholarly KGQA
KW - Scholarly-QALD
KW - RKG
KW - SciQA
UR - http://www.scopus.com/inward/record.url?scp=85180546080&partnerID=8YFLogxK
U2 - 10.48550/ARXIV.2311.09841
DO - 10.48550/ARXIV.2311.09841
M3 - Article in conference proceedings
VL - 3592
T3 - CEUR Workshop Proceedings
BT - Joint Proceedings of Scholarly QALD 2023 and SemREC 2023 co-located with 22nd International Semantic Web Conference ISWC 2023, Athens, Greece, November 6-10, 2023
A2 - Banerjee, Debayan
A2 - Usbeck, Ricardo
A2 - Mihindukulasooriya, Nandana
A2 - Singh, Gunjan
A2 - Mutharaju, Raghava
A2 - Kapanipathi, Pavan
PB - CEUR-WS.org
T2 - Scholarly QALD 2023
Y2 - 6 November 2023 through 10 November 2023
ER -
