Why reinvent the wheel: Let's build question answering systems together

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

  • Kuldeep Singh
  • Arun Sethupat Radhakrishna
  • Andreas Both
  • Saeedeh Shekarpour
  • Ioanna Lytra
  • Ricardo Usbeck
  • Akhilesh Vyas
  • Akmal Khikmatullaev
  • Dharmen Punjani
  • Christoph Lange
  • Maria Esther Vidal
  • Jens Lehmann
  • Sören Auer

Modern question answering (QA) systems need to flexibly integrate a number of components specialised to fulfil specific tasks in a QA pipeline. Key QA tasks include Named Entity Recognition and Disambiguation, Relation Extraction, and Query Building. Since a number of different software components exist that implement different strategies for each of these tasks, it is a major challenge to select and combine the most suitable components into a QA system, given the characteristics of a question. We study this optimisation problem and train classifiers, which take features of a question as input and have the goal of optimising the selection of QA components based on those features. We then devise a greedy algorithm to identify the pipelines that include the suitable components and can effectively answer the given question. We implement this model within Frankenstein, a QA framework able to select QA components and compose QA pipelines. We evaluate the effectiveness of the pipelines generated by Frankenstein using the QALD and LC-QuAD benchmarks. These results not only suggest that Frankenstein precisely solves the QA optimisation problem but also enables the automatic composition of optimised QA pipelines, which outperform the static Baseline QA pipeline. Thanks to this flexible and fully automated pipeline generation process, new QA components can be easily included in Frankenstein, thus improving the performance of the generated pipelines.

Original languageEnglish
Title of host publicationThe Web Conference 2018 - Proceedings of the World Wide Web Conference, WWW 2018
EditorsPierre-Antoine Champin, Fabien Gandon, Lionel Medini
Number of pages10
PublisherAssociation for Computing Machinery, Inc
Publication date10.04.2018
Pages1247-1256
ISBN (print)978-1-4503-5639-8
DOIs
Publication statusPublished - 10.04.2018
Externally publishedYes
Event27th International World Wide Web, WWW 2018: Bridging natural and artificial intelligence worldwide - Universität Lyon, Lyon, France
Duration: 23.04.201827.04.2018
https://archives.iw3c2.org/www2018/

Bibliographical note

Publisher Copyright:
© 2018 IW3C2 (International World Wide Web Conference Committee), published under Creative Commons CC BY 4.0 License.

DOI

Recently viewed

Researchers

  1. Hana Attia

Publications

  1. Existenzgründungen junger Handwerksmeister
  2. The Radius of Trust Problem Remains Resolved
  3. An Analysis of Methane Mitigation as a Response to Climate Change
  4. Personal need for structure as a boundary condition for humor in leadership
  5. Habitat suitability models in conservation planning – a short introduction
  6. Determinants and Development of Schools in Organization Theory
  7. Ecologies of things and texts
  8. Study Protocol
  9. Score-Informed Analysis of Tuning, Intonation, Pitch Modulation, and Dynamics in Jazz Solos
  10. Leverage points and levers of inclusive conservation in protected areas
  11. Facilitative-competitive interactions in an Old-Growth Forest: The Importance of Large-Diameter Trees as Benefactors and Stimulators for Forest Community Assembly
  12. 'Saving' the city
  13. Introduction - Teaching Artistic Strategies. Playing with Materiality, Aesthetics and Ambiguity
  14. Machine Learning Analysis in the Diagnostics of the Dynamics of Ball Bearing with Different Radial Internal Clearance
  15. Re-registration as a means of altering a company's status
  16. Managing Research Environments
  17. Zwischen Assimilation und Multikultur
  18. Tormentil for active ulcerative colitis
  19. Leveraging Biodiversity Action From Plural Values
  20. Citizen Relationship Management (CRM)
  21. Differential responses of ecosystem components to a low-intensity fire in a Mediterranean forest
  22. Application of non-target analysis with LC-HRMS for the monitoring of raw and potable water
  23. Akademisches Schreiben
  24. A modeling assessment of the physicochemical properties and environmental fate of emerging and novel per- and polyfluoroalkyl substances
  25. Prediction of improvement in quality of life (QoL-AGHDA) in adults with growth hormone deficiency by normative reference limits: data of the German KIMS cohort
  26. Nachhaltigkeit als Treiber des Unternehmenserfolgs
  27. Impacts of software and its engineering on the carbon footprint of ICT
  28. Sowing density
  29. Ansatzkonzeptionen
  30. Incomplete aerobic degradation of the antidiabetic drug Metformin and identification of the bacterial dead-end transformation product Guanylurea
  31. Leading digital innovation in schools
  32. Interacting effects of pollination, water and nutrients on fruit tree performance
  33. Determination of brand-equity from a consumer-oriented perspective