DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generation

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

Task-oriented dialogue generation is challenging since the underlying knowledge is often dynamic and effectively incorporating knowledge into the learning process is hard. It is particularly challenging to generate both humanlike and informative responses in this setting. Recent research primarily focused on various knowledge distillation methods where the underlying relationship between the facts in a knowledge base is not effectively captured. In this paper, we go one step further and demonstrate how the structural information of a knowledge graph can improve the system's inference capabilities. Specifically, we propose DialoKG, a novel task-oriented dialogue system that effectively incorporates knowledge into a language model. Our proposed system views relational knowledge as a knowledge graph and introduces (1) a structure-aware knowledge embedding technique, and (2) a knowledge graph-weighted attention masking strategy to facilitate the system selecting relevant information during the dialogue generation. An empirical evaluation demonstrates the effectiveness of DialoKG over state-of-theart methods on several standard benchmark datasets.

Original languageEnglish
Title of host publicationFindings of the Association for Computational Linguistics : NAACL 2022 - Findings
Number of pages15
PublisherAssociation for Computational Linguistics (ACL)
Publication date01.01.2022
Pages2557-2571
ISBN (electronic)9781955917766
DOIs
Publication statusPublished - 01.01.2022
Externally publishedYes
Event2022 Findings of the Association for Computational Linguistics - NAACL 2022 - Online + Hyatt Regency Seattle, Seattle, United States
Duration: 10.07.202215.07.2022
https://2022.naacl.org/downloads/handbook-final-v2.pdf
https://aclanthology.org/2022.findings-naacl.0/

Bibliographical note

Funding Information:
We acknowledge the support of the following projects: SPEAKER (BMWi FKZ 01MK20011A), JOSEPH (Fraunhofer Zukunftsstiftung), OpenGPT-X (BMWK FKZ 68GX21007A), the excellence clusters ML2R (BmBF FKZ 01 15 18038 A/B/C), ScaDS.AI (IS18026A-F) and TAILOR (EU GA 952215). The authors also acknowledge the financial support by the Federal Ministry for Economic Affairs and Energy of Germany in the project CoyPu (project number 01MK21007G).

Publisher Copyright:
© Findings of the Association for Computational Linguistics: NAACL 2022 - Findings.