1. //
  2. Start
  3. //
  4. Publications
  5. The Role of Output Vocabulary in T2T LMs...
  6. Output formats
  7. //

The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Standard

The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing. / Banerjee, Debayan; Nair, Pranav; Usbeck, Ricardo et al.

Findings of the Association for Computational Linguistics: ACL 2023 : July 9-14, 2023. ed. / Anna Rogers; Jordan L. Boyd-Graber; Naoaki Okazaki. Stroudsburg : Association for Computational Linguistics (ACL), 2023. p. 12219-12228 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Harvard

Banerjee, D, Nair, P, Usbeck, R & Biemann, C 2023, The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing. in A Rogers, JL Boyd-Graber & N Okazaki (eds), Findings of the Association for Computational Linguistics: ACL 2023 : July 9-14, 2023. Proceedings of the Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics (ACL), Stroudsburg, pp. 12219-12228, 61st Annual Meeting of the Association for Computational Linguistics, Toronto, Ontario, Canada, 09.07.23. https://doi.org/10.18653/v1/2023.findings-acl.774, https://doi.org/10.48550/arXiv.2305.15108

APA

Banerjee, D., Nair, P., Usbeck, R., & Biemann, C. (2023). The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing. In A. Rogers, J. L. Boyd-Graber, & N. Okazaki (Eds.), Findings of the Association for Computational Linguistics: ACL 2023 : July 9-14, 2023 (pp. 12219-12228). (Proceedings of the Annual Meeting of the Association for Computational Linguistics). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2023.findings-acl.774, https://doi.org/10.48550/arXiv.2305.15108

Vancouver

Banerjee D, Nair P, Usbeck R, Biemann C. The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing. In Rogers A, Boyd-Graber JL, Okazaki N, editors, Findings of the Association for Computational Linguistics: ACL 2023 : July 9-14, 2023. Stroudsburg: Association for Computational Linguistics (ACL). 2023. p. 12219-12228. (Proceedings of the Annual Meeting of the Association for Computational Linguistics). doi: 10.18653/v1/2023.findings-acl.774, 10.48550/arXiv.2305.15108

Bibtex

@inbook{5d6369c3cb2e4ab19990cad2ed7aa3f7,
title = "The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing",
abstract = "In this work, we analyse the role of output vocabulary for text-to-text (T2T) models on the task of SPARQL semantic parsing. We perform experiments within the the context of knowledge graph question answering (KGQA), where the task is to convert questions in natural language to the SPARQL query language. We observe that the query vocabulary is distinct from human vocabulary. Language Models (LMs) are pre-dominantly trained for human language tasks, and hence, if the query vocabulary is replaced with a vocabulary more attuned to the LM tokenizer, the performance of models may improve. We carry out carefully selected vocabulary substitutions on the queries and find absolute gains in the range of 17% on the GrailQA dataset.",
keywords = "Business informatics, Informatics",
author = "Debayan Banerjee and Pranav Nair and Ricardo Usbeck and Chris Biemann",
note = "Publisher Copyright: {\textcopyright} 2023 Association for Computational Linguistics.; 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023 ; Conference date: 09-07-2023 Through 14-07-2023",
year = "2023",
month = jul,
day = "1",
doi = "10.18653/v1/2023.findings-acl.774",
language = "English",
series = "Proceedings of the Annual Meeting of the Association for Computational Linguistics",
publisher = "Association for Computational Linguistics (ACL)",
pages = "12219--12228",
editor = "Anna Rogers and Boyd-Graber, {Jordan L.} and Naoaki Okazaki",
booktitle = "Findings of the Association for Computational Linguistics: ACL 2023",
address = "United States",
url = "https://2023.aclweb.org",

}

RIS

TY - CHAP

T1 - The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing

AU - Banerjee, Debayan

AU - Nair, Pranav

AU - Usbeck, Ricardo

AU - Biemann, Chris

N1 - Conference code: 61

PY - 2023/7/1

Y1 - 2023/7/1

N2 - In this work, we analyse the role of output vocabulary for text-to-text (T2T) models on the task of SPARQL semantic parsing. We perform experiments within the the context of knowledge graph question answering (KGQA), where the task is to convert questions in natural language to the SPARQL query language. We observe that the query vocabulary is distinct from human vocabulary. Language Models (LMs) are pre-dominantly trained for human language tasks, and hence, if the query vocabulary is replaced with a vocabulary more attuned to the LM tokenizer, the performance of models may improve. We carry out carefully selected vocabulary substitutions on the queries and find absolute gains in the range of 17% on the GrailQA dataset.

AB - In this work, we analyse the role of output vocabulary for text-to-text (T2T) models on the task of SPARQL semantic parsing. We perform experiments within the the context of knowledge graph question answering (KGQA), where the task is to convert questions in natural language to the SPARQL query language. We observe that the query vocabulary is distinct from human vocabulary. Language Models (LMs) are pre-dominantly trained for human language tasks, and hence, if the query vocabulary is replaced with a vocabulary more attuned to the LM tokenizer, the performance of models may improve. We carry out carefully selected vocabulary substitutions on the queries and find absolute gains in the range of 17% on the GrailQA dataset.

KW - Business informatics

KW - Informatics

UR - http://www.scopus.com/inward/record.url?scp=85175442200&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/ef5423a8-c326-3827-a9f1-bbd3d0e21ba1/

U2 - 10.18653/v1/2023.findings-acl.774

DO - 10.18653/v1/2023.findings-acl.774

M3 - Article in conference proceedings

T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics

SP - 12219

EP - 12228

BT - Findings of the Association for Computational Linguistics: ACL 2023

A2 - Rogers, Anna

A2 - Boyd-Graber, Jordan L.

A2 - Okazaki, Naoaki

PB - Association for Computational Linguistics (ACL)

CY - Stroudsburg

T2 - 61st Annual Meeting of the Association for Computational Linguistics

Y2 - 9 July 2023 through 14 July 2023

ER -

Other publications by the same author(s)

DBLP-QuAD: A Question Answering Dataset over the DBLP Scholarly Knowledge Graph

Banerjee, D., Awale, S., Usbeck, R. & Biemann, C., 17.01.2024, BIR 2023 - Bibliometric-enhanced Information Retrieval: Proceedings of the 13th International Workshop on Bibliometric-enhanced Information Retrieval co-located with 45th European Conference on Information Retrieval (ECIR 2023). Frommholz, I., Mayr, P., Cabanac, G., Verberne, S. & Brennan, J. (eds.). Aachen: Sun Site Central Europe (RWTH Aachen University), 15 p. 5. (CUER Workshop Proceedings; vol. 3617).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

EARL: Joint entity and relation linking for question answering over knowledge graphs

Dubey, M., Banerjee, D., Chaudhuri, D. & Lehmann, J., 18.09.2018, The Semantic Web – ISWC 2018: 17th International Semantic Web Conference, Monterey, CA, USA, October 8–12, 2018 : proceedings. Vrandecic, D., Bontcheva, K., Suárez-Figueroa, M. C., Presutti, V., Celino, I., Sabou, M., Kaffee, L-A. & Simperl, E. (eds.). Cham: Springer Schweiz, Vol. 1. p. 108-126 19 p. (Lecture Notes in Computer Science ; vol. 11136 LNCS).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Event Extraction Alone Is Not Enough

Huang, J., Jiang, L., Möller, C. & Usbeck, R., 05.2024, Narrative Extraction From Texts 2024: Proceedings of Text2Story — Seventh Workshop on Narrative Extraction From Texts held in conjunction with the 46th European Conference on Information Retrieval (ECIR 2024). Campos, R., Jorge, A. M., Jatowt, A., Bhatia, S. & Litvak, M. (eds.). Aachen: Rheinisch-Westfaelische Technische Hochschule Aachen, Vol. 3671. p. 105-114 10 p. (CEUR Workshop Proceedings; vol. 3671).

Research output: Contributions to collected editions/works › Conference contribution › peer-review

Harvesting information from captions for weakly supervised semantic segmentation

Sawatzky, J., Banerjee, D. & Gall, J., 10.2019, 2019 International Conference on Computer Vision Workshops: ICCV 2019 : proceedings : 27 October-2 November 2019, Seoul, Korea. Piscataway: Institute of Electrical and Electronics Engineers Inc., p. 4481-4490 10 p. 9022140. (IEEE International Conference on Computer Vision workshops; vol. 2019).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

LC-QuAD 2.0: A Large Dataset for Complex Question Answering over Wikidata and DBpedia

Dubey, M., Banerjee, D., Abdelkawi, A. & Lehmann, J., 2019, The Semantic Web – ISWC 2019 : 18th International Semantic Web Conference, Auckland, New Zealand, October 26-30, 2019 : proceedings. Ghidini, C., Hartig, O., Maleshkova, M., Svátek, V., Cruz, I., Hogan, A., Song, J., Lefrançois, M. & Gandon, F. (eds.). Cham: Springer, Vol. 2. p. 69-78 10 p. (Lecture Notes in Computer Science; vol. 11779 LNCS).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

DOI