An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

  • Rricha Jalota
  • Priyansh Trivedi
  • Gaurav Maheshwari
  • Axel Cyrille Ngonga Ngomo
  • Ricardo Usbeck

As chatbots are gaining popularity for simplifying access to information and community interaction, it is essential to examine whether these agents are serving their intended purpose and catering to the needs of their users. Therefore, we present an approach to perform an ex-post-facto analysis over the logs of knowledge base-driven dialogue systems. Using the DBpedia Chatbot as our case study, we inspect three aspects of the interactions, (i) user queries and feedback, (ii) the bot’s response to these queries, and (iii) the overall flow of the conversations. We discuss key implications based on our findings. All the source code used for the analysis can be found at https://github.com/dice-group/DBpedia-Chatlog-Analysis.

Original languageEnglish
Title of host publicationChatbot Research and Design : 3rd International Workshop, CONVERSATIONS 2019
EditorsAsbjørn Følstad, Theo Araujo, Symeon Papadopoulos, Effie Lai-Chong Law, Ole-Christoffer Granmo, Ewa Luger, Petter Bae Brandtzaeg
Number of pages15
PublisherSpringer
Publication date2020
Pages19-33
ISBN (print)978-3-030-39539-1
ISBN (electronic)978-3-030-39540-7
DOIs
Publication statusPublished - 2020
Externally publishedYes
Event3rd International Workshop on Chatbot Research and Design, CONVERSATIONS 2019 - Universität Amsterdam, Amsterdam, Netherlands
Duration: 19.11.201920.11.2019
http://www.digicomlab.eu/events/past-events/conversations-2019-workshop/
https://conversations2019.wordpress.com/program/

Bibliographical note

This work has been supported by the Federal Ministry of Transport and Digital Infrastructure (BMVI) in the OPAL research project (grant no. 19F2028A) and LIMBO (no. 19F2029I) as well as by the German Federal Ministry of Education and Research (BMBF) within ‘KMU-innovativ: Forschung für die zivile Sicherheit’ in particular ‘Forschung für die zivile Sicherheit’ and the project SOLIDE (no. 13N14456).

Publisher Copyright:
© 2020, Springer Nature Switzerland AG.