Why reinvent the wheel: Let's build question answering systems together

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

  • Kuldeep Singh
  • Arun Sethupat Radhakrishna
  • Andreas Both
  • Saeedeh Shekarpour
  • Ioanna Lytra
  • Ricardo Usbeck
  • Akhilesh Vyas
  • Akmal Khikmatullaev
  • Dharmen Punjani
  • Christoph Lange
  • Maria Esther Vidal
  • Jens Lehmann
  • Sören Auer

Modern question answering (QA) systems need to flexibly integrate a number of components specialised to fulfil specific tasks in a QA pipeline. Key QA tasks include Named Entity Recognition and Disambiguation, Relation Extraction, and Query Building. Since a number of different software components exist that implement different strategies for each of these tasks, it is a major challenge to select and combine the most suitable components into a QA system, given the characteristics of a question. We study this optimisation problem and train classifiers, which take features of a question as input and have the goal of optimising the selection of QA components based on those features. We then devise a greedy algorithm to identify the pipelines that include the suitable components and can effectively answer the given question. We implement this model within Frankenstein, a QA framework able to select QA components and compose QA pipelines. We evaluate the effectiveness of the pipelines generated by Frankenstein using the QALD and LC-QuAD benchmarks. These results not only suggest that Frankenstein precisely solves the QA optimisation problem but also enables the automatic composition of optimised QA pipelines, which outperform the static Baseline QA pipeline. Thanks to this flexible and fully automated pipeline generation process, new QA components can be easily included in Frankenstein, thus improving the performance of the generated pipelines.

OriginalspracheEnglisch
TitelThe Web Conference 2018 - Proceedings of the World Wide Web Conference, WWW 2018
HerausgeberPierre-Antoine Champin, Fabien Gandon, Lionel Medini
Anzahl der Seiten10
VerlagAssociation for Computing Machinery, Inc
Erscheinungsdatum10.04.2018
Seiten1247-1256
ISBN (Print)978-1-4503-5639-8
DOIs
PublikationsstatusErschienen - 10.04.2018
Extern publiziertJa
Veranstaltung27th International World Wide Web, WWW 2018: Bridging natural and artificial intelligence worldwide - Universität Lyon, Lyon, Frankreich
Dauer: 23.04.201827.04.2018
https://archives.iw3c2.org/www2018/

Bibliographische Notiz

Funding Information:
This work has received funding from the EU H2020 R&I programme for the Marie Skłodowska-Curie action WDAqua (GA No 642795), Eurostars project QAMEL (E!9725), and EU H2020 R&I HOBBIT (GA 688227). We thank Yakun Li, Osmar Zaiane, and Anant Gupta for their useful suggestions.

Funding Information:
This work has received funding from the EU H2020 R&I programme for the Marie Sklodowska-Curie action WDAqua (GA No 642795), Eurostars project QAMEL (E!9725), and EU H2020 R&I HOBBIT (GA 688227). We thank Yakun Li, Osmar Zaiane, and Anant Gupta for their useful suggestions.

Publisher Copyright:
© 2018 IW3C2 (International World Wide Web Conference Committee), published under Creative Commons CC BY 4.0 License.

DOI

Zuletzt angesehen

Publikationen

  1. Technological Innovation System des Schwungmassenspeichers
  2. Evaluating social learning in participatory mapping of ecosystem services
  3. Mathematik 1
  4. Calling and career preparation
  5. Community resilience for a 1.5 degrees C world
  6. Komparative studier i børnelitterature
  7. OSZE
  8. Texturig Space
  9. Institutional change in the German higher education system
  10. Personalbeschaffung
  11. Austria
  12. Transindividuelle Affizierung
  13. Development of high strength-ductility Mg-Er extruded alloys by micro-alloying with Mn
  14. Article 21 Formal Validity
  15. A framework for disentangling ecological mechanisms underlying the island species–area relationship
  16. The power of philology between sacralisation and poetic and aesthetic semi-secularisation
  17. A high power dye laser pumped by a crowbar mode flashlamp
  18. Mechanisms of short-term soil carbon storage in experimental grasslands
  19. Requests in Informal Conversations
  20. Supportive Mental Health Self-Monitoring among Smartphone Users with Psychological Distress
  21. Tree species richness strengthens relationships between ants and the functional composition of spider assemblages in a highly diverse forest
  22. WhatsApp und das prozessuale Interface
  23. Broadening the scope of ecosystem services research
  24. Positive Adolescent Career Development
  25. Process parameter assessment on the dissimilar deposition of AA2024-T351 on AA7475-T761 by friction surfacing
  26. Energy management for inductive power transmission
  27. Recycling-oriented fabrication of soft robots
  28. Special issue on Responsible Management Learning:
  29. Pricing effects when competitors arrive
  30. Every single word
  31. Can learning to move foster sustainable development? A systematic literature review examining the potential of sport and physical activity in the context of environmental and sustainability education
  32. Variation in gaze following across the life span
  33. Existential Graphs as Ontographic Media