1. //
  2. Start
  3. //
  4. Publications
  5. QALD-9-plus
  6. Output formats
  7. //

QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakers

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Standard

QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakers. / Perevalov, Aleksandr; Diefenbach, Dennis; Usbeck, Ricardo et al.
Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022. Institute of Electrical and Electronics Engineers Inc., 2022. p. 229-234 (Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Harvard

Perevalov, A, Diefenbach, D, Usbeck, R & Both, A 2022, QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakers. in Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022. Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022, Institute of Electrical and Electronics Engineers Inc., pp. 229-234, 16th IEEE International Conference on Semantic Computing, ICSC 2022, Virtual, Online, United States, 26.01.22. https://doi.org/10.48550/arxiv.2202.00120, https://doi.org/10.1109/ICSC52841.2022.00045

APA

Perevalov, A., Diefenbach, D., Usbeck, R., & Both, A. (2022). QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakers. In Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022 (pp. 229-234). (Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.48550/arxiv.2202.00120, https://doi.org/10.1109/ICSC52841.2022.00045

Vancouver

Perevalov A, Diefenbach D, Usbeck R, Both A. QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakers. In Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022. Institute of Electrical and Electronics Engineers Inc. 2022. p. 229-234. (Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022). doi: 10.48550/arxiv.2202.00120, 10.1109/ICSC52841.2022.00045

Bibtex

@inbook{e7c01674f3c641618070a759f46d8b46,
title = "QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakers",
abstract = "The ability to have the same experience for different user groups (i.e., accessibility) is one of the most important characteristics of Web-based systems. The same is true for Knowledge Graph Question Answering (KGQA) systems that provide the access to Semantic Web data via natural language interface. While following our research agenda on the multilingual aspect of accessibility of KGQA systems, we identified several ongoing challenges. One of them is the lack of multilingual KGQA benchmarks. In this work, we extend one of the most popular KGQA benchmarks - QALD-9 by introducing high-quality questions' translations to 8 languages provided by native speakers, and transferring the SPARQL queries of QALD-9 from DBpedia to Wikidata, s.t., the usability and relevance of the dataset is strongly increased. Five of the languages - Armenian, Ukrainian, Lithuanian, Bashkir and Belarusian - to our best knowledge were never considered in KGQA research community before. The latter two of the languages are considered as 'endangered' by UNESCO. We call the extended dataset QALD-9-plus and made it available online11Figshare: https://doi.org/10.6084/m9.figshare.16864273. GitHub: https://github.com/Perevalov/qald-9-plus.",
keywords = "multilingual question answering, question answering dataset, question answering over knowledge graphs, Informatics, Business informatics",
author = "Aleksandr Perevalov and Dennis Diefenbach and Ricardo Usbeck and Andreas Both",
note = "Publisher Copyright: {\textcopyright} 2022 IEEE.; 16th IEEE International Conference on Semantic Computing, ICSC 2022 ; Conference date: 26-01-2022 Through 28-01-2022",
year = "2022",
doi = "10.48550/arxiv.2202.00120",
language = "English",
isbn = "978-1-6654-3419-5",
series = "Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "229--234",
booktitle = "Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022",
address = "United States",
url = "http://pa.icar.cnr.it/scsn22/",

}

RIS

TY - CHAP

T1 - QALD-9-plus

T2 - 16th IEEE International Conference on Semantic Computing, ICSC 2022

AU - Perevalov, Aleksandr

AU - Diefenbach, Dennis

AU - Usbeck, Ricardo

AU - Both, Andreas

N1 - Publisher Copyright: © 2022 IEEE.

PY - 2022

Y1 - 2022

N2 - The ability to have the same experience for different user groups (i.e., accessibility) is one of the most important characteristics of Web-based systems. The same is true for Knowledge Graph Question Answering (KGQA) systems that provide the access to Semantic Web data via natural language interface. While following our research agenda on the multilingual aspect of accessibility of KGQA systems, we identified several ongoing challenges. One of them is the lack of multilingual KGQA benchmarks. In this work, we extend one of the most popular KGQA benchmarks - QALD-9 by introducing high-quality questions' translations to 8 languages provided by native speakers, and transferring the SPARQL queries of QALD-9 from DBpedia to Wikidata, s.t., the usability and relevance of the dataset is strongly increased. Five of the languages - Armenian, Ukrainian, Lithuanian, Bashkir and Belarusian - to our best knowledge were never considered in KGQA research community before. The latter two of the languages are considered as 'endangered' by UNESCO. We call the extended dataset QALD-9-plus and made it available online11Figshare: https://doi.org/10.6084/m9.figshare.16864273. GitHub: https://github.com/Perevalov/qald-9-plus.

AB - The ability to have the same experience for different user groups (i.e., accessibility) is one of the most important characteristics of Web-based systems. The same is true for Knowledge Graph Question Answering (KGQA) systems that provide the access to Semantic Web data via natural language interface. While following our research agenda on the multilingual aspect of accessibility of KGQA systems, we identified several ongoing challenges. One of them is the lack of multilingual KGQA benchmarks. In this work, we extend one of the most popular KGQA benchmarks - QALD-9 by introducing high-quality questions' translations to 8 languages provided by native speakers, and transferring the SPARQL queries of QALD-9 from DBpedia to Wikidata, s.t., the usability and relevance of the dataset is strongly increased. Five of the languages - Armenian, Ukrainian, Lithuanian, Bashkir and Belarusian - to our best knowledge were never considered in KGQA research community before. The latter two of the languages are considered as 'endangered' by UNESCO. We call the extended dataset QALD-9-plus and made it available online11Figshare: https://doi.org/10.6084/m9.figshare.16864273. GitHub: https://github.com/Perevalov/qald-9-plus.

KW - multilingual question answering

KW - question answering dataset

KW - question answering over knowledge graphs

KW - Informatics

KW - Business informatics

UR - http://www.scopus.com/inward/record.url?scp=85127617150&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/8126760b-6314-36b1-9f9c-c20003d56bba/

U2 - 10.48550/arxiv.2202.00120

DO - 10.48550/arxiv.2202.00120

M3 - Article in conference proceedings

AN - SCOPUS:85127617150

SN - 978-1-6654-3419-5

T3 - Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022

SP - 229

EP - 234

BT - Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 26 January 2022 through 28 January 2022

ER -

Other publications by the same author(s)

Bridging the Gap: Generating a Comprehensive Biomedical Knowledge Graph Question Answering Dataset

Yan, X., Westphal, P., Seliger, J. & Usbeck, R., 2024, ECAI 2024 : 27th European Conference on Artificial Intelligence, 19-24 October 2024, Santiago de Compostela, Spain; including 13th Conference on Prestigious Applications of Intelligent Systems (PAIS 2024), Proceedings. Endriss, U., Melo, F. S., Bach, K., Diz, A. J. B., Alonso-Moral, J. M., Barro, S. & Heintz, F. (eds.). Amsterdam: IOS Press BV, p. 1198-1205 8 p. (Frontiers in Artificial Intelligence and Applications; vol. 392).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

D2R2 2024: Linked Data-driven Resilience Research 2024: Proceedings of the Third International Workshop on Linked Data-driven Resilience Research (D2R2'24) co-located with European Semantic Web Conference 2024 (ESWC 2024), May 27, 2024

Holze, J. (ed.), Tramp, S. (ed.), Martin, M. (ed.), Auer, S. (ed.), Usbeck, R. (ed.) & Krdzavac, N. (ed.), 2024, Aachen: Rheinisch-Westfaelische Technische Hochschule Aachen. (CEUR Workshop Proceedings; vol. 3707)

Research output: Books and anthologies › Conference proceedings › Research

DBLP-QuAD: A Question Answering Dataset over the DBLP Scholarly Knowledge Graph

Banerjee, D., Awale, S., Usbeck, R. & Biemann, C., 17.01.2024, BIR 2023 - Bibliometric-enhanced Information Retrieval: Proceedings of the 13th International Workshop on Bibliometric-enhanced Information Retrieval co-located with 45th European Conference on Information Retrieval (ECIR 2023). Frommholz, I., Mayr, P., Cabanac, G., Verberne, S. & Brennan, J. (eds.). Aachen: Sun Site Central Europe (RWTH Aachen University), 15 p. 5. (CUER Workshop Proceedings; vol. 3617).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Entity Linking with Out-of-Knowledge-Graph Entity Detection and Clustering Using Only Knowledge Graphs

Möller, C. & Usbeck, R., 11.09.2024, Knowledge Graphs in the Age of Language Models and Neuro-Symbolic AI- : Proceedings of the 20th International Conference on Semantic Systems, 17-19 September 2024, Amsterdam, The Netherlands. Salatino, A. A., Alam, M., Ongenae, F., Vahdati, S., Gentile, A. L., Pellegrini, T. & Jiang, S. (eds.). Amsterdam: IOS Press BV, p. 88-105 18 p. (Studies on the Semantic Web; vol. 60).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Event Extraction Alone Is Not Enough

Huang, J., Jiang, L., Möller, C. & Usbeck, R., 05.2024, Narrative Extraction From Texts 2024: Proceedings of Text2Story — Seventh Workshop on Narrative Extraction From Texts held in conjunction with the 46th European Conference on Information Retrieval (ECIR 2024). Campos, R., Jorge, A. M., Jatowt, A., Bhatia, S. & Litvak, M. (eds.). Aachen: Rheinisch-Westfaelische Technische Hochschule Aachen, Vol. 3671. p. 105-114 10 p. (CEUR Workshop Proceedings; vol. 3671).

Research output: Contributions to collected editions/works › Conference contribution › peer-review

DOI