The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Standard

The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing. / Banerjee, Debayan; Nair, Pranav; Usbeck, Ricardo et al.
Findings of the Association for Computational Linguistics: ACL 2023 : July 9-14, 2023. ed. / Anna Rogers; Jordan L. Boyd-Graber; Naoaki Okazaki. Stroudsburg: Association for Computational Linguistics (ACL), 2023. p. 12219-12228 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Harvard

Banerjee, D, Nair, P, Usbeck, R & Biemann, C 2023, The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing. in A Rogers, JL Boyd-Graber & N Okazaki (eds), Findings of the Association for Computational Linguistics: ACL 2023 : July 9-14, 2023. Proceedings of the Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics (ACL), Stroudsburg, pp. 12219-12228, 61st Annual Meeting of the Association for Computational Linguistics, Toronto, Ontario, Canada, 09.07.23. https://doi.org/10.18653/v1/2023.findings-acl.774, https://doi.org/10.48550/arXiv.2305.15108

APA

Banerjee, D., Nair, P., Usbeck, R., & Biemann, C. (2023). The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing. In A. Rogers, J. L. Boyd-Graber, & N. Okazaki (Eds.), Findings of the Association for Computational Linguistics: ACL 2023 : July 9-14, 2023 (pp. 12219-12228). (Proceedings of the Annual Meeting of the Association for Computational Linguistics). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2023.findings-acl.774, https://doi.org/10.48550/arXiv.2305.15108

Vancouver

Banerjee D, Nair P, Usbeck R, Biemann C. The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing. In Rogers A, Boyd-Graber JL, Okazaki N, editors, Findings of the Association for Computational Linguistics: ACL 2023 : July 9-14, 2023. Stroudsburg: Association for Computational Linguistics (ACL). 2023. p. 12219-12228. (Proceedings of the Annual Meeting of the Association for Computational Linguistics). doi: 10.18653/v1/2023.findings-acl.774, 10.48550/arXiv.2305.15108

Bibtex

@inbook{5d6369c3cb2e4ab19990cad2ed7aa3f7,
title = "The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing",
abstract = "In this work, we analyse the role of output vocabulary for text-to-text (T2T) models on the task of SPARQL semantic parsing. We perform experiments within the the context of knowledge graph question answering (KGQA), where the task is to convert questions in natural language to the SPARQL query language. We observe that the query vocabulary is distinct from human vocabulary. Language Models (LMs) are pre-dominantly trained for human language tasks, and hence, if the query vocabulary is replaced with a vocabulary more attuned to the LM tokenizer, the performance of models may improve. We carry out carefully selected vocabulary substitutions on the queries and find absolute gains in the range of 17% on the GrailQA dataset.",
keywords = "Business informatics, Informatics",
author = "Debayan Banerjee and Pranav Nair and Ricardo Usbeck and Chris Biemann",
note = "Publisher Copyright: {\textcopyright} 2023 Association for Computational Linguistics.; 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023 ; Conference date: 09-07-2023 Through 14-07-2023",
year = "2023",
month = jul,
day = "1",
doi = "10.18653/v1/2023.findings-acl.774",
language = "English",
series = "Proceedings of the Annual Meeting of the Association for Computational Linguistics",
publisher = "Association for Computational Linguistics (ACL)",
pages = "12219--12228",
editor = "Anna Rogers and Boyd-Graber, {Jordan L.} and Naoaki Okazaki",
booktitle = "Findings of the Association for Computational Linguistics: ACL 2023",
address = "United States",
url = "https://2023.aclweb.org",

}

RIS

TY - CHAP

T1 - The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing

AU - Banerjee, Debayan

AU - Nair, Pranav

AU - Usbeck, Ricardo

AU - Biemann, Chris

N1 - Conference code: 61

PY - 2023/7/1

Y1 - 2023/7/1

N2 - In this work, we analyse the role of output vocabulary for text-to-text (T2T) models on the task of SPARQL semantic parsing. We perform experiments within the the context of knowledge graph question answering (KGQA), where the task is to convert questions in natural language to the SPARQL query language. We observe that the query vocabulary is distinct from human vocabulary. Language Models (LMs) are pre-dominantly trained for human language tasks, and hence, if the query vocabulary is replaced with a vocabulary more attuned to the LM tokenizer, the performance of models may improve. We carry out carefully selected vocabulary substitutions on the queries and find absolute gains in the range of 17% on the GrailQA dataset.

AB - In this work, we analyse the role of output vocabulary for text-to-text (T2T) models on the task of SPARQL semantic parsing. We perform experiments within the the context of knowledge graph question answering (KGQA), where the task is to convert questions in natural language to the SPARQL query language. We observe that the query vocabulary is distinct from human vocabulary. Language Models (LMs) are pre-dominantly trained for human language tasks, and hence, if the query vocabulary is replaced with a vocabulary more attuned to the LM tokenizer, the performance of models may improve. We carry out carefully selected vocabulary substitutions on the queries and find absolute gains in the range of 17% on the GrailQA dataset.

KW - Business informatics

KW - Informatics

UR - http://www.scopus.com/inward/record.url?scp=85175442200&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/ef5423a8-c326-3827-a9f1-bbd3d0e21ba1/

U2 - 10.18653/v1/2023.findings-acl.774

DO - 10.18653/v1/2023.findings-acl.774

M3 - Article in conference proceedings

T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics

SP - 12219

EP - 12228

BT - Findings of the Association for Computational Linguistics: ACL 2023

A2 - Rogers, Anna

A2 - Boyd-Graber, Jordan L.

A2 - Okazaki, Naoaki

PB - Association for Computational Linguistics (ACL)

CY - Stroudsburg

T2 - 61st Annual Meeting of the Association for Computational Linguistics

Y2 - 9 July 2023 through 14 July 2023

ER -

Recently viewed

Publications

  1. Mining Implications From Data
  2. Agile Portfolio Management Patterns
  3. Efficacy of a Web-Based Intervention With Mobile Phone Support in Treating Depressive Symptoms in Adults With Type 1 and Type 2 Diabetes
  4. Visual Frames – Framing Visuals
  5. Neural Networks for Energy Optimization of Production Processes in Small and Medium Sized Enterprises
  6. Educational reconstruction as model for the theory-based design of student-centered learning environments in electrical engineering courses
  7. Biodegradability and genotoxicity of surface functionalized colloidal silica (SiO2) particles in the aquatic environment
  8. Self-perceived quality of life predicts mortality risk better than a multi-biomarker panel, but the combination of both does best
  9. Clustering design science research based on the nature of the designed artifact
  10. Reconciling conservation and development in protected areas of the Global South
  11. Contextualizing the relationship between self-commitment and performance
  12. Polynomial Augmented Extended Kalman Filter to Estimate the State of Charge of Lithium-Ion Batteries
  13. What´s in a net? or: The end of the average
  14. Measurement in Machine Vision Editorial Paper
  15. Statistical precipitation bias correction of gridded model data using point measurements
  16. Value Structure and Dimensions
  17. Soft Skills for Hard Constraints
  18. Effect of gap distortion on the field splitting of collective modes in superfluid He3-B
  19. Orchestrating distributed data governance in open social innovation
  20. Non-acceptances in context
  21. Image, Process, Performance, Machine
  22. Effects of plyometric training on postural control in static and dynamic testing situations
  23. Self-perception of the internal audit function within the corporate governance system - Empirical evidence for the European Union
  24. Simulation-based Investigation of Energy Flexibility in the Optimization of Hinterland Drainage
  25. Design, Modeling and Control of an Over-actuated Hexacopter Tilt-Rotor