An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Standard

An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot. / Jalota, Rricha; Trivedi, Priyansh; Maheshwari, Gaurav et al.
Chatbot Research and Design: 3rd International Workshop, CONVERSATIONS 2019. ed. / Asbjørn Følstad; Theo Araujo; Symeon Papadopoulos; Effie Lai-Chong Law; Ole-Christoffer Granmo; Ewa Luger; Petter Bae Brandtzaeg. Springer, 2020. p. 19-33 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11970 LNCS).

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Harvard

Jalota, R, Trivedi, P, Maheshwari, G, Ngonga Ngomo, AC & Usbeck, R 2020, An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot. in A Følstad, T Araujo, S Papadopoulos, EL-C Law, O-C Granmo, E Luger & PB Brandtzaeg (eds), Chatbot Research and Design: 3rd International Workshop, CONVERSATIONS 2019. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11970 LNCS, Springer, pp. 19-33, 3rd International Workshop on Chatbot Research and Design, CONVERSATIONS 2019, Amsterdam, Netherlands, 19.11.19. https://doi.org/10.1007/978-3-030-39540-7_2

APA

Jalota, R., Trivedi, P., Maheshwari, G., Ngonga Ngomo, A. C., & Usbeck, R. (2020). An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot. In A. Følstad, T. Araujo, S. Papadopoulos, E. L.-C. Law, O.-C. Granmo, E. Luger, & P. B. Brandtzaeg (Eds.), Chatbot Research and Design: 3rd International Workshop, CONVERSATIONS 2019 (pp. 19-33). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11970 LNCS). Springer. https://doi.org/10.1007/978-3-030-39540-7_2

Vancouver

Jalota R, Trivedi P, Maheshwari G, Ngonga Ngomo AC, Usbeck R. An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot. In Følstad A, Araujo T, Papadopoulos S, Law ELC, Granmo OC, Luger E, Brandtzaeg PB, editors, Chatbot Research and Design: 3rd International Workshop, CONVERSATIONS 2019. Springer. 2020. p. 19-33. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-39540-7_2

Bibtex

@inbook{465f0589e0a3417ba0bb71aa35d292f1,
title = "An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot",
abstract = "As chatbots are gaining popularity for simplifying access to information and community interaction, it is essential to examine whether these agents are serving their intended purpose and catering to the needs of their users. Therefore, we present an approach to perform an ex-post-facto analysis over the logs of knowledge base-driven dialogue systems. Using the DBpedia Chatbot as our case study, we inspect three aspects of the interactions, (i) user queries and feedback, (ii) the bot{\textquoteright}s response to these queries, and (iii) the overall flow of the conversations. We discuss key implications based on our findings. All the source code used for the analysis can be found at https://github.com/dice-group/DBpedia-Chatlog-Analysis.",
keywords = "Conversational AI, Empirical study, Intent clustering, Knowledge graph, Knowledge-driven chatbot, Informatics, Business informatics",
author = "Rricha Jalota and Priyansh Trivedi and Gaurav Maheshwari and {Ngonga Ngomo}, {Axel Cyrille} and Ricardo Usbeck",
note = "This work has been supported by the Federal Ministry of Transport and Digital Infrastructure (BMVI) in the OPAL research project (grant no. 19F2028A) and LIMBO (no. 19F2029I) as well as by the German Federal Ministry of Education and Research (BMBF) within {\textquoteleft}KMU-innovativ: Forschung f{\"u}r die zivile Sicherheit{\textquoteright} in particular {\textquoteleft}Forschung f{\"u}r die zivile Sicherheit{\textquoteright} and the project SOLIDE (no. 13N14456). Publisher Copyright: {\textcopyright} 2020, Springer Nature Switzerland AG.; 3rd International Workshop on Chatbot Research and Design, CONVERSATIONS 2019 ; Conference date: 19-11-2019 Through 20-11-2019",
year = "2020",
doi = "10.1007/978-3-030-39540-7_2",
language = "English",
isbn = "978-3-030-39539-1",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer",
pages = "19--33",
editor = "Asbj{\o}rn F{\o}lstad and Theo Araujo and Symeon Papadopoulos and Law, {Effie Lai-Chong} and Ole-Christoffer Granmo and Ewa Luger and Brandtzaeg, {Petter Bae}",
booktitle = "Chatbot Research and Design",
address = "Germany",
url = "http://www.digicomlab.eu/events/past-events/conversations-2019-workshop/, https://conversations2019.wordpress.com/program/",

}

RIS

TY - CHAP

T1 - An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot

AU - Jalota, Rricha

AU - Trivedi, Priyansh

AU - Maheshwari, Gaurav

AU - Ngonga Ngomo, Axel Cyrille

AU - Usbeck, Ricardo

N1 - This work has been supported by the Federal Ministry of Transport and Digital Infrastructure (BMVI) in the OPAL research project (grant no. 19F2028A) and LIMBO (no. 19F2029I) as well as by the German Federal Ministry of Education and Research (BMBF) within ‘KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ‘Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456). Publisher Copyright: © 2020, Springer Nature Switzerland AG.

PY - 2020

Y1 - 2020

N2 - As chatbots are gaining popularity for simplifying access to information and community interaction, it is essential to examine whether these agents are serving their intended purpose and catering to the needs of their users. Therefore, we present an approach to perform an ex-post-facto analysis over the logs of knowledge base-driven dialogue systems. Using the DBpedia Chatbot as our case study, we inspect three aspects of the interactions, (i) user queries and feedback, (ii) the bot’s response to these queries, and (iii) the overall flow of the conversations. We discuss key implications based on our findings. All the source code used for the analysis can be found at https://github.com/dice-group/DBpedia-Chatlog-Analysis.

AB - As chatbots are gaining popularity for simplifying access to information and community interaction, it is essential to examine whether these agents are serving their intended purpose and catering to the needs of their users. Therefore, we present an approach to perform an ex-post-facto analysis over the logs of knowledge base-driven dialogue systems. Using the DBpedia Chatbot as our case study, we inspect three aspects of the interactions, (i) user queries and feedback, (ii) the bot’s response to these queries, and (iii) the overall flow of the conversations. We discuss key implications based on our findings. All the source code used for the analysis can be found at https://github.com/dice-group/DBpedia-Chatlog-Analysis.

KW - Conversational AI

KW - Empirical study

KW - Intent clustering

KW - Knowledge graph

KW - Knowledge-driven chatbot

KW - Informatics

KW - Business informatics

UR - http://www.scopus.com/inward/record.url?scp=85079089976&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-39540-7_2

DO - 10.1007/978-3-030-39540-7_2

M3 - Article in conference proceedings

AN - SCOPUS:85079089976

SN - 978-3-030-39539-1

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 19

EP - 33

BT - Chatbot Research and Design

A2 - Følstad, Asbjørn

A2 - Araujo, Theo

A2 - Papadopoulos, Symeon

A2 - Law, Effie Lai-Chong

A2 - Granmo, Ole-Christoffer

A2 - Luger, Ewa

A2 - Brandtzaeg, Petter Bae

PB - Springer

T2 - 3rd International Workshop on Chatbot Research and Design, CONVERSATIONS 2019

Y2 - 19 November 2019 through 20 November 2019

ER -