TextGraphs 2024 Shared Task on Text-Graph Representations for Knowledge Graph Question Answering

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

This paper describes the results of the Knowledge Graph Question Answering (KGQA) shared task that was co-located with the TextGraphs 2024 workshop. In this task, given a textual question and a list of entities with the corresponding KG subgraphs, the participating system should choose the entity that correctly answers the question. Our competition attracted thirty teams, four of which outperformed our strong ChatGPT-based zero-shot baseline. In this paper, we overview the participating systems and analyze their performance according to a large-scale automatic evaluation. To the best of our knowledge, this is the first competition aimed at the KGQA problem using the interaction between large language models (LLMs) and knowledge graphs.
OriginalspracheEnglisch
TitelProceedings of TextGraphs-17: Graph-based Methods for Natural Language Processing : Graph-Based Methods for Natural Language Processing, 62nd Annual Meeting of the Association of Computational Linguistics
HerausgeberDmitry Ustalov, Yanjun Gao, Alexander Pachenko, Elena Tutubalina, Irina Nikishina, Arti Ramesh, Andrey Sakhovskiy, Ricardo Usbeck, Gerald Penn, Marco Valentino
Anzahl der Seiten10
ErscheinungsortKerrville
VerlagAssociation for Computational Linguistics (ACL)
Erscheinungsdatum01.08.2024
Seiten116-125
ISBN (elektronisch)979-8-89176-145-2
PublikationsstatusErschienen - 01.08.2024
VeranstaltungTextGraphs-17: Graph-based Methods for Natural Language Processing - Bangkok, Thailand
Dauer: 15.08.202415.08.2024
Konferenznummer: 17
https://sites.google.com/view/textgraphs2024

Bibliographische Notiz

Publisher Copyright:
© 2024 Association for Computational Linguistics.

Links

Zuletzt angesehen

Publikationen

  1. Assessing Effects Through Semi-Field and Field Toxicity Testing
  2. Mathematics in Robot Control for Theoretical and Applied Problems
  3. Temporal processes in prime–mask interaction
  4. Influence of Process Parameters and Die Design on the Microstructure and Texture Development of Direct Extruded Magnesium Flat Products
  5. A new way of assessing the interaction of a metallic phase precursor with a modified oxide support substrate as a source of information for predicting metal dispersion
  6. Analysis And Comparison Of Dispatching RuleBased Scheduling In Dual-Resource Constrained Shop-Floor Scenarios
  7. The Dialectics of Open Access
  8. Teaching methods for modelling problems and students’ task-specific enjoyment, value, interest and self-efficacy expectations
  9. Adaptive control of the nonlinear dynamic behavior of the cantilever-sample system of an atomic force microscope
  10. Recontextualizing Anthropomorphic Metaphors in Organization Studies
  11. Global fern and lycophyte richness explained: How regional and local factors shape plot richness
  12. A comprehensive Eulerian modeling framework for airborne mercury species
  13. Influence of Long-Lasting Static Stretching Intervention on Functional and Morphological Parameters in the Plantar Flexors
  14. Using EEG movement tagging to isolate brain responses coupled to biological movements
  15. How to support students-learning in mathematical bridging-courses using ITS? Remedial Scenarios in the EU-Project Math-Bridge
  16. Active plasma resonance spectroscopy: Eigenfunction solutions in spherical geometry
  17. Master of Disaster: A Disaster-Related Event Monitoring System From News Streams
  18. Theorie des Quantum Computings
  19. Pathways of Data-driven Business Model Design and Realization
  20. Sensorless Control of AC Motor Drives with Adaptive Extended Kalman Filter
  21. Rapid grain refinement and compositional homogenization in a cast binary Cu50Ni alloy achieved by friction stir processing
  22. Towards Advanced Learning in Dispatching Rule-Based Scheuling
  23. More than a YouTube Channel
  24. Magnesium-based metal matrix nanocomposites—processing and properties
  25. Predicting online user behavior based on Real-Time Advertising Data
  26. Statistical methods for the evaluation of hydrological parameters for landuse planning
  27. Noninteracting optimal and adaptive torque control using an online parameter estimation with help of polynomials in EKF for a PMSM
  28. Scale-dependent diversity patterns affect spider assemblages of two contrasting forest ecosystems
  29. Photodegradation of micropollutants using V-UV/UV-C processes