Knowledge Graph Question Answering Leaderboard: A Community Resource to Prevent a Replication Crisis

Perevalov, A., Yan, X., Kovriguina, L., Jiang, L., Both, A. & Usbeck, R., 2022, 2022 Language Resources and Evaluation Conference, LREC 2022. Calzolari, N., Bechet, F., Blache, P., Choukri, K., Cieri, C., Declerck, T., Goggi, S., Isahara, H., Maegaard, B., Mariani, J., Mazo, H., Odijk, J. & Piperidis, S. (eds.). European Language Resources Association (ELRA), p. 2998-3007 10 p. (2022 Language Resources and Evaluation Conference, LREC 2022).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Measuring Gender Bias in German Language Generation

Kraft, A., Zorn, H. P., Fecht, P., Simon, J., Biemann, C. & Usbeck, R., 2022, INFORMATIK 2022 - Informatik in den Naturwissenschaften. Demmler, D., Krupka, D. & Federrath, H. (eds.). Bonn: Gesellschaft für Informatik e.V., p. 1257-1274 18 p. (Lecture Notes in Informatics (LNI), Proceedings - Series of the Gesellschaft fur Informatik (GI); vol. P-326).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakers

Perevalov, A., Diefenbach, D., Usbeck, R. & Both, A., 2022, Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022. Institute of Electrical and Electronics Engineers Inc., p. 229-234 6 p. (Proceedings - 16th IEEE International Conference on Semantic Computing, ICSC 2022).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

RoMe: A Robust Metric for Evaluating Natural Language Generation

Al Hasan Rony, M. R., Kovriguina, L., Chaudhuri, D., Usbeck, R. & Lehmann, J., 2022, ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). Muresan, S., Nakov, P. & Villavicencio, A. (eds.). Association for Computational Linguistics (ACL), p. 5645-5657 13 p. (Proceedings of the Annual Meeting of the Association for Computational Linguistics; vol. 1).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Semantic Answer Type and Relation Prediction Task (SMART 2021)

Mihindukulasooriya, N., Dubey, M., Gliozzo, A., Lehmann, J., Ngomo, A.-C. N., Usbeck, R., Rossiello, G. & Kumar, U., 07.12.2021, (In preparation) Conference XXX. 6 p.

Research output: Contributions to collected editions/works › Article in conference proceedings › Research

Proxy Indicators for the Quality of Open-domain Dialogues

Nedelchev, R., Lehmann, J. & Usbeck, R., 01.01.2021, EMNLP 2021 - 2021 Conference on Empirical Methods in Natural Language Processing, Proceedings. Moens, M.-F., Huang, X., Specia, L. & Wen-tau Yih, S. (eds.). Association for Computational Linguistics (ACL), p. 7834-7855 22 p. (EMNLP 2021 - 2021 Conference on Empirical Methods in Natural Language Processing, Proceedings).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Template-based Question Answering using Recursive Neural Networks

Athreya, R. G., Bansal, S. K., Ngomo, A. C. N. & Usbeck, R., 01.2021, Proceedings - 2021 IEEE 15th International Conference on Semantic Computing, ICSC 2021. Institute of Electrical and Electronics Engineers Inc., p. 195-198 4 p. 9364639. (Proceedings - 2021 IEEE 15th International Conference on Semantic Computing, ICSC 2021).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Knowledge Graph Question Answering Using Graph-Pattern Isomorphism

Vollmers, D., Jalota, R., Moussallem, D., Topiwala, H., Ngomo, A.-C. N. & Usbeck, R., 2021, Further with Knowledge Graphs - Proceedings of the 17th International Conference on Semantic Systems, SEMANTiCS 2017, Amsterdam, The Netherlands, September 6-9, 2021. Alam, M., Groth, P., Boer, V. D., Pellegrini, T., Pandit, H. J., Montiel-Ponsoda, E., Rodríguez-Doncel, V., McGillivray, B. & Meroño-Peñuela, A. (eds.). Netherlands: IOS Press BV, Vol. 53. p. 103-117 15 p. (Studies on the Semantic Web; vol. 53).

Research output: Contributions to collected editions/works › Chapter › peer-review

Language Model Transformers as Evaluators for Open-domain Dialogues

Nedelchev, R., Lehmann, J. & Usbeck, R., 01.01.2020, COLING 2020 - 28th International Conference on Computational Linguistics: Proceedings of the Conference. Scott, D., Bel, N. & Zong, C. (eds.). Association for Computational Linguistics (ACL), p. 6797-6808 12 p. (COLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Message passing for hyper-relational knowledge graphs

Galkin, M., Trivedi, P., Maheshwari, G., Usbeck, R. & Lehmann, J., 01.01.2020, EMNLP 2020 - 2020 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference. Webber, B., Cohn, T., He, Y. & Liu, Y. (eds.). Association for Computational Linguistics (ACL), p. 7346-7359 14 p. (EMNLP 2020 - 2020 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot

Jalota, R., Trivedi, P., Maheshwari, G., Ngonga Ngomo, A. C. & Usbeck, R., 2020, Chatbot Research and Design: 3rd International Workshop, CONVERSATIONS 2019. Følstad, A., Araujo, T., Papadopoulos, S., Law, E.L.-C., Granmo, O.-C., Luger, E. & Brandtzaeg, P. B. (eds.). Springer, p. 19-33 15 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 11970 LNCS).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Finding Datasets in Publications: The University of Paderborn Approach

Jalota, R., Srivastava, N., Vollmers, D., Speck, R., Röder, M., Usbeck, R. & Ngomo, A.-C. N., 2020, Rich Search and Discovery for Research Datasets: Building the next generation of Scholary infrastructure. Lane, J. I., Mulvany, I. & Nathan, P. (eds.). SAGE Publications Inc., p. 129-141 13 p.

Research output: Contributions to collected editions/works › Chapter › peer-review

Towards an Interoperable Ecosystem of AI and LT Platforms: A Roadmap for the Implementation of Different Levels of Interoperability

Rehm, G., Galanis, D., Labropoulou, P., Piperidis, S., Welß, M., Usbeck, R., Köhler, J., Deligiannis, M., Gkirtzou, K., Fischer, J., Chiarcos, C., Feldhus, N., Moreno-Schneider, J., Kintzel, F., Montiel-Ponsoda, E., Rodrguez-Doncel, V., McCrae, J. P., Laqua, D., Theile, I. P., Dittmar, C., Bontcheva, K., Roberts, I., Vasiljevs, A. & Lagzdins, A., 2020, Proceedings of the 1st International Workshop on Language Technology Platforms, IWLTP@LREC 2020, Marseille, France, May 2020. Rehm, G., Bontcheva, K., Choukri, K., Hajic, J., Piperidis, S. & Vasiljevs, A. (eds.). European Language Resources Association (ELRA), p. 96-107 12 p.

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Treating dialogue quality evaluation as an anomaly detection problem

Nedelchev, R., Lehmann, J. & Usbeck, R., 2020, LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings. Calzolari, N., Bechet, F., Blache, P., Choukri, K., Cieri, C., Declerck, T., Goggi, S., Isahara, H., Maegaard, B., Mariani, J., Mazo, H., Moreno, A., Odijk, J. & Piperidis, S. (eds.). European Language Resources Association (ELRA), p. 508-512 5 p. (LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Offline question answering over linked data using limited resources

Kaur, P., Blücher, V., Jalota, R., Moussallem, D., Ngomo, A. C. N. & Usbeck, R., 09.2019, SEMPDS 2019: Posters and Demos at SEMANTiCS 2019. Alam, M., Usbeck, R., Pellegrini, T., Sack, H. & Sure-Vetter, Y. (eds.). Sun Site Central Europe (RWTH Aachen University), Vol. 2451. (CEUR Workshop Proceedings; vol. 2451).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

QUANT - Question Answering Benchmark Curator

Gusmita, R. H., Jalota, R., Vollmers, D., Reineke, J., Ngonga Ngomo, A. C. & Usbeck, R., 01.01.2019, Semantic Systems. The Power of AI and Knowledge Graphs - 15th International Conference, SEMANTiCS 2019 Proceedings. Acosta, M., Sure-Vetter, Y., Cudré-Mauroux, P., Maleshkova, M., Pellegrini, T. & Sack, H. (eds.). Springer, p. 343-358 16 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 11702 LNCS).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

BENGAL: An automatic benchmark generator for entity recognition and linking

Ngomo, A. C. N., Röder, M., Moussallem, D., Usbeck, R. & Speck, R., 01.11.2018, INLG 2018 - 11th International Natural Language Generation Conference, Proceedings of the Conference. Krahmer, E., Gatt, A. & Goudbeek, M. (eds.). Association for Computational Linguistics (ACL), p. 339-349 11 p. (INLG 2018 - 11th International Natural Language Generation Conference, Proceedings of the Conference).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

8th challenge on question answering over linked data (QALD-8)

Usbeck, R., Ngomo, A. C. N., Conrads, F., Röder, M. & Napolitano, G., 10.2018, SemDeep-4_NLIWOD-4 2018: Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4. Choi, K.-S., Anke, L. E., Decklerck, T., Gromann, D., Kim, J.-D., Ngomo, A.-C. N., Saleem, M. & Usbeck, R. (eds.). Sun Site Central Europe (RWTH Aachen University), Vol. 2241. p. 51-57 7 p. (CEUR Workshop Proceedings; vol. 2241).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

9th challenge on question answering over linked data (QALD-9)

Usbeck, R., Gusmita, R. H., Ngomo, A. C. N. & Saleem, M., 10.2018, SemDeep-4_NLIWOD-4 2018: Joint Proceedings of ISWC 2018 Workshops SemDeep-4 and NLIWOD-4. Choi, K.-S., Anke, L. E., Decklerck, T., Gromann, D., Kim, J.-D., Ngomo, A.-C. N., Saleem, M. & Usbeck, R. (eds.). Sun Site Central Europe (RWTH Aachen University), Vol. 2241. p. 58-64 7 p. (CEUR Workshop Proceedings; vol. 2241).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Enhancing Community Interactions with Data-Driven Chatbots - The DBpedia Chatbot

Athreya, R. G., Ngonga Ngomo, A. C. & Usbeck, R., 23.04.2018, The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018. Champin, P.-A., Gandon, F. & Medini, L. (eds.). Association for Computing Machinery, Inc, p. 143-146 4 p. (The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Question Answering Mediated by Visual Clues and Knowledge Graphs

Faria, F. F., Usbeck, R., Sarullo, A., Mu, T. & Freitas, A., 23.04.2018, The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018. Association for Computing Machinery, Inc, p. 1937-1939 3 p. (The Web Conference 2018 - Companion of the World Wide Web Conference, WWW 2018; vol. 2018-January).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Why reinvent the wheel: Let's build question answering systems together

Singh, K., Radhakrishna, A. S., Both, A., Shekarpour, S., Lytra, I., Usbeck, R., Vyas, A., Khikmatullaev, A., Punjani, D., Lange, C., Vidal, M. E., Lehmann, J. & Auer, S., 10.04.2018, The Web Conference 2018 - Proceedings of the World Wide Web Conference, WWW 2018. Champin, P.-A., Gandon, F. & Medini, L. (eds.). Association for Computing Machinery, Inc, p. 1247-1256 10 p. (The Web Conference 2018 - Proceedings of the World Wide Web Conference, WWW 2018).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Entity linking in 40 languages using MAG

Moussallem, D., Usbeck, R., Röder, M. & Ngonga Ngomo, A. C., 2018, The Semantic Web: ESWC 2018 Satellite Events - ESWC 2018, Revised Selected Papers. Gangemi, A., Gentile, A. L., Paulheim, H., Maleshkova, M., Rudolph, S., Pan, J. Z., Alam, M. & Nuzzolese, A. G. (eds.). Springer-Verlag Wien, p. 176-181 6 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 11155 LNCS).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

The Scalable Question Answering Over Linked Data (SQA) Challenge 2018

Napolitano, G., Usbeck, R. & Ngomo, A. C. N., 2018, Semantic Web Challenges - 5th SemWebEval Challenge at ESWC 2018, Revised Selected Papers. Reforgiato Recupero, D., Gangemi, A. & Buscaldi, D. (eds.). Springer-Verlag Wien, p. 69-75 7 p. (Communications in Computer and Information Science; vol. 927).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

MAG: A multilingual, knowledge-base agnostic and deterministic entity linking approach

Moussallem, D., Usbeck, R., Röder, M. & Ngomo, A. C. N., 04.12.2017, Proceedings of the Knowledge Capture Conference, K-CAP 2017. Association for Computing Machinery, Inc, p. 1-8 8 p. 9. (Proceedings of the Knowledge Capture Conference, K-CAP 2017).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Using Multi-Label Classification for Improved Question Answering

Usbeck, R., Hoffmann, M., Röder, M., Lehmann, J. & Ngomo, A.-C. N., 24.10.2017, (In preparation) Conference XXX. 15 p.

Research output: Contributions to collected editions/works › Article in conference proceedings › Research

GENESIS - A generic RDF data access interface

Ermilov, T., Moussallem, D., Usbeck, R. & Ngomo, A. C. N., 23.08.2017, Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017. Sheth, A. (ed.). Association for Computing Machinery, Inc, p. 125-131 7 p. (Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Holistic and scalable ranking of RDF data

Ngomo, N., Ngomo, N., Hoffmann, M., Usbeck, R. & Jha, K., 01.07.2017, Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017. Nie, J.-Y., Obradovic, Z., Suzumura, T., Ghosh, R., Nambiar, R., Wang, C., Zang, H., Baeza-Yates, R., Baeza-Yates, R., Hu, X., Kepner, J., Cuzzocrea, A., Tang, J. & Toyoda, M. (eds.). Institute of Electrical and Electronics Engineers Inc., p. 746-755 10 p. (Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017; vol. 2018-January).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

7th open challenge on question answering over linked data (QALD-7)

Usbeck, R., Ngomo, A. C. N., Haarmann, B., Krithara, A., Röder, M. & Napolitano, G., 2017, Semantic Web Challenges - 4th SemWebEval Challenge at ESWC 2017, Revised Selected Papers. Dragoni, M., Solanki, M. & Blomqvist, E. (eds.). Springer International Publishing AG, p. 59-69 11 p. (Communications in Computer and Information Science; vol. 769).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

OKBQA framework towards an open collaboration for development of natural language question-answering systems over knowledge bases

Kim, J. D., Unger, C., Ngomo, A. C. N., Freitas, A., Hahm, Y. G., Kim, J., Nam, S., Choi, G. H., Kim, J. U., Usbeck, R., Kang, M. G. & Choi, K. S., 2017, ISWC-P&D-Industry 2017: Proceedings of the ISWC 2017 Posters & Demonstrations and Industry Tracks. Nikitina, N., Song, D., Fokoue, A. & Haase, P. (eds.). Sun Site Central Europe (RWTH Aachen University), Vol. 1963. 4 p. (CEUR Workshop Proceedings; vol. 1963).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Question answering over linked data: What is difficult to answer? What affects the F scores?

Saleem, M., Dastjerdi, S. N., Usbeck, R. & Ngomo, A. C. N., 2017, Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3 : Natural Language Interfaces for the Web of Data. Usbeck, R., Ngomo, A.-C. N., Kim, J.-D., Choi, K.-S., Cimiano, P., Fundulaki, I. & Krithara, A. (eds.). Sun Site Central Europe (RWTH Aachen University), Vol. 1932. (CEUR Workshop Proceedings; vol. 1932).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Self-Wiring Question Answering Systems

Usbeck, R., Huthmann, J., Duldhardt, N. & Ngomo, A.-C. N., 08.11.2016, (In preparation) Conference XXX. 6 p.

Research output: Contributions to collected editions/works › Article in conference proceedings › Research

Requirements to modern semantic search engine

Usbeck, R., Röder, M., Haase, P., Kozlov, A., Saleem, M. & Ngonga Ngomo, A. C., 06.09.2016, Knowledge Engineering and Semantic Web - 7th International Conference, KESW 2016, Proceedings. Ngomo, A.-C. N. & Křemen, P. (eds.). Springer Nature Switzerland AG, p. 328-343 16 p. (Communications in Computer and Information Science; vol. 649).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

A scalable approach for computing semantic relatedness using semantic web data

Diefenbach, D., Usbeck, R., Singh, K. D. & Maret, P., 13.06.2016, 6th International Conference on Web Intelligence, Mining and Semantics, WIMS 2016. Bellot, P., Montmain, J., Harispe, S., Trousset, F., Plantie, M., Akerkar, R., Laurent, A. & Ranwez, S. (eds.). Association for Computing Machinery, Inc, 9 p. 20. (ACM International Conference Proceeding Series; vol. 13-15-June-2016).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

CubeQA—question answering on RDF data cubes

Höffner, K., Lehmann, J. & Usbeck, R., 01.01.2016, The Semantic Web – ISWC 2016: 15th International Semantic Web Conference, Kobe, Japan, October 17–21, 2016, Proceedings, Part I. Groth, P., Simperl, E., Gray, A., Sabou, M., Krotzsch, M., Lecue, F., Lecue, F., Flock, F. & Gil, Y. (eds.). Springer-Verlag Wien, p. 325-340 16 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 9981 LNCS).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

MEX vocabulary: A lightweight interchange format for machine learning experiments

Esteves, D., Moussallem, D., Neto, C. B., Soru, T., Usbeck, R., Ackermann, M. & Lehmann, J., 16.09.2015, Proceedings of the 11th International Conference on Semantic Systems, SEMANTiCS 2015. Polleres, A., Hellmann, S. & Parreira, J. X. (eds.). Association for Computing Machinery, Inc, p. 169-176 8 p. (ACM International Conference Proceeding Series; vol. 16-17-September-2015).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

HAWK@QALD5 - Trying to answer hybrid questions with various simple ranking techniques

Usbeck, R. & Ngomo, A. C. N., 09.2015, CLEF 2015: Working Notes of CLEF 2015 - Conference and Labs of the Evaluation forum Toulouse, France, September 8-11, 2015.. Cappellato, L., Ferro, N., Jones, G. J. F. & Juan, E. S. (eds.). Sun Site Central Europe (RWTH Aachen University), Vol. 1391. p. 1-7 7 p. 69. (CEUR Workshop Proceedings; vol. 1391).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

GERBIL - General entity annotator benchmarking framework

Usbeck, R., Röder, M., Ngomo, A. C. N., Baron, C., Both, A., Brümmer, M., Ceccarelli, D., Cornolti, M., Cherix, D., Eickmann, B., Ferragina, P., Lemke, C., Moro, A., Navigli, R., Piccinno, F., Rizzo, G., Sack, H., Speck, R., Troncy, R., Waitelonis, J. & Wesemann, L., 18.05.2015, WWW 2015 - Proceedings of the 24th International Conference on World Wide Web. Gangemi, A., Leonardi, S. & Panconesi, A. (eds.). Association for Computing Machinery, Inc, p. 1133-1143 11 p. (WWW 2015 - Proceedings of the 24th International Conference on World Wide Web).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review