Leveraging LLMs in Scholarly Knowledge Graph Question Answering

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner. The model initially identifies the top-n similar training questions related to a given test question via a BERT-based sentence encoder and retrieves their corresponding SPARQL. Using the top-n similar question-SPARQL pairs as an example and the test question creates a prompt. Then pass the prompt to the LLM and generate a SPARQL. Finally, runs the SPARQL against the underlying KG - ORKG (Open Research KG) endpoint and returns an answer. Our system achieves an F1 score of 99.0%, on SciQA - one of the Scholarly-QALD-23 challenge benchmarks.
Original languageEnglish
Title of host publicationJoint Proceedings of Scholarly QALD 2023 and SemREC 2023 co-located with 22nd International Semantic Web Conference ISWC 2023, Athens, Greece, November 6-10, 2023
EditorsDebayan Banerjee, Ricardo Usbeck, Nandana Mihindukulasooriya, Gunjan Singh, Raghava Mutharaju, Pavan Kapanipathi
Number of pages10
Volume3592
PublisherCEUR-WS.org
Publication date2023
DOIs
Publication statusPublished - 2023
EventScholarly QALD 2023 - Athen, Greece
Duration: 06.11.202310.11.2023
Conference number: 1
https://ceur-ws.org/Vol-3592/

Bibliographical note

Publisher Copyright:
© 2023 CEUR-WS. All rights reserved.

    Research areas

  • Informatics - Knowledge Graph Question Answering (KGQA), pen Research Knowledge Graph, arge Language Model, Scholarly KGQA, Scholarly-QALD, RKG, SciQA

Recently viewed

Publications

  1. Minimalist Training
  2. Studienprogramm Nachhaltigkeit
  3. A focus group for operationalizing software sustainability with the MEASURE platform
  4. A continental-scale analysis of feral cat diet in Australia
  5. Dangerous settings and risky international assignments
  6. Super-Twisting Sliding Mode Control for Differential Steering Systems in Vehicular Yaw Tracking Motion
  7. Insect decline in forests depends on species’ traits and may be mitigated by management
  8. Between joint project, institutional bargaining and symbolic politics
  9. Ausschüsse
  10. Holland’s secondary constructs of vocational interests and career choice readiness of secondary students
  11. Correction to Neighbourhood stories: role of neighbour identity, spatial location and order of arrival in legume and non-legume initial interactions
  12. Language, Literature and the Environment
  13. Multi-trophic communities re-establish with canopy cover and microclimate in a subtropical forest biodiversity experiment
  14. Anleitung zum Perspektivenwechsel
  15. HPLC/MS/MS in der wasseranalytik
  16. A new approach to data evaluation in the non-target screening of organic trace substances in water analysis
  17. Termination of life support measures in case of persons in permanent vegetative state.
  18. Phonographie
  19. Intermission at the Combat Zone
  20. CULTURAL TENSIONS AND VALUES-ACTION GAPS IN SUSTAINABILITY-ORIENTED INNOVATION
  21. Introducing Residual Stresses on Sheet Metals by Slide Hardening under Stress Superposition
  22. Treppauf, Treppab
  23. Legitimacy and the Cognitive Sources of International Institutional Change
  24. Revisiting diversity management:
  25. Tierschutz in der Verfassung und was nun?
  26. The Meaning of Natality – Doğumluluğun Anlami
  27. How Does Pre-Service Teachers’ Self-Efficacy Relate to the Fulfilment of Basic Psychological Needs During Teaching Practicum?
  28. Thinking about "scenes"
  29. „Round Robin“ oder auch Siegerbesieger
  30. Psychological, sociodemographic, and infrastructural factors as determinants of ecological impact caused by mobility behavior
  31. Erratum zu