TextGraphs 2024 Shared Task on Text-Graph Representations for Knowledge Graph Question Answering

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

This paper describes the results of the Knowledge Graph Question Answering (KGQA) shared task that was co-located with the TextGraphs 2024 workshop. In this task, given a textual question and a list of entities with the corresponding KG subgraphs, the participating system should choose the entity that correctly answers the question. Our competition attracted thirty teams, four of which outperformed our strong ChatGPT-based zero-shot baseline. In this paper, we overview the participating systems and analyze their performance according to a large-scale automatic evaluation. To the best of our knowledge, this is the first competition aimed at the KGQA problem using the interaction between large language models (LLMs) and knowledge graphs.
OriginalspracheEnglisch
TitelProceedings of TextGraphs-17: Graph-based Methods for Natural Language Processing : Graph-Based Methods for Natural Language Processing, 62nd Annual Meeting of the Association of Computational Linguistics
HerausgeberDmitry Ustalov, Yanjun Gao, Alexander Pachenko, Elena Tutubalina, Irina Nikishina, Arti Ramesh, Andrey Sakhovskiy, Ricardo Usbeck, Gerald Penn, Marco Valentino
Anzahl der Seiten10
ErscheinungsortKerrville
VerlagAssociation for Computational Linguistics (ACL)
Erscheinungsdatum01.08.2024
Seiten116-125
ISBN (elektronisch)979-8-89176-145-2
PublikationsstatusErschienen - 01.08.2024
VeranstaltungTextGraphs-17: Graph-based Methods for Natural Language Processing - Bangkok, Thailand
Dauer: 15.08.202415.08.2024
Konferenznummer: 17
https://sites.google.com/view/textgraphs2024

Bibliographische Notiz

Publisher Copyright:
© 2024 Association for Computational Linguistics.

Links

Zuletzt angesehen

Aktivitäten

  1. Hibernationstation

Publikationen

  1. Effectiveness of a Web-Based Cognitive Behavioural Intervention for Subthreshold Depression
  2. Masked Autoencoder Pretraining for Event Classification in Elite Soccer
  3. What is missing in the EVS?
  4. Diversity: Konzept. Programmatik. Praxis.
  5. Avoiding irreversible change
  6. Adding the “e-” to Learning for Sustainable Development
  7. Plants, Androids and Operators
  8. Foundations for the Development of Simulator-based Training for Older Professional Drivers
  9. An Extended Kalman Filter as an Observer in a Sliding Mode Controller for a Metal-Polymer Composite Actuator
  10. Effect of erbium modification on the microstructure, mechanical and corrosion characteristics of binary Mg-Al alloys
  11. University mathematics students’ use of resources: strategies, purposes, and consequences
  12. Random year intercepts in mixed models help to assess uncertainties in insect population trends
  13. Dynamische Mathematik
  14. Performance of the Chemcatcher ® passive sampler when used to monitor 10 polar and semi-polar pesticides in 16 Central European streams, and comparison with two other sampling methods
  15. Using the learner-generated drawing strategy
  16. Learning-related emotions in multimedia learning
  17. Nonautonomous control of stable and unstable manifolds in two-dimensional flows
  18. Exporter and Importer Dynamics Database for Germany
  19. Hermann Stutte
  20. Digitalisierung und Differenzierung
  21. Accuracy and bias of methods used for root length measurements in functional root research
  22. A new magnesium alloy system
  23. Sustainable Wireless Sensor Networks for Railway Systems Powered by Energy Harvesting from Vibration
  24. Export diversification and income differences reconsidered
  25. Machine Learning for the Quantified Self
  26. Part based decentralized information handling for process improvements along the supply chain
  27. Biodiversity and ecosystem functioning relations in European forests depend on environmental context.
  28. ADORE-Project Teaching Adolescent Struggling Readers
  29. Ports
  30. Along the Path of the Pine, the Parrot, and the Tortoise
  31. Study harder? the relationship of achievement goals to attitudes and self-reported use of desirable difficulties in self-regulated learning
  32. What makes online professional development effective?
  33. Measuring institutional overlap in global governance
  34. The Shareholder Value Effect of System Overloads: An Analysis of Investor Responses to the 2003 Blackout in the US
  35. Human development and the "explosion" of democracy
  36. Development of tools to prevent food waste
  37. Methan - das unterschätzte Klimagas
  38. Paradoxe Kritik
  39. Publikationsbasierte Dissertation?!
  40. Evidence-based Entrepreneurship (EBE): A systematic approach to cumulative science
  41. Odors enhance visual attention to congruent objects
  42. Existenzgründungen junger Handwerksmeister
  43. VALUES-BASED BUSINESS MODEL INNOVATION-THE CASE OF ECOSIA AND ITS BUSINESS MODEL
  44. System Properties Determine Food Security and Biodiversity Outcomes at Landscape Scale