Neural relational inference for disaster multimedia retrieval

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

Events around the world are increasingly documented on social media, especially by the people experiencing them, as these platforms become more popular over time. As a consequence, social media turns into a valuable source of data for understanding those events. Due to their destructive potential, natural disasters are among events of particular interest to response operations and environmental monitoring agencies. However, this amount of information also makes it challenging to identify relevant content pertaining to those events. In this paper, we use a relational neural network model for identifying this type of content. The model is particularly suitable for unstructured text, that is, text with no particular arrangement of words, such as tags, which is commonplace in social media data. In addition, our method can be combined with a CNN for handling multimodal data where text and visual data are available. We perform experiments in three different scenarios, where different modalities are evaluated: visual, textual, and both. Our method achieves competitive performance in both modalities by themselves, while significantly outperforms the baseline on the multimodal scenario. We also demonstrate the behavior of the proposed method in different applications by performing additional experiments in the CUB-200-2011 multimodal dataset.

OriginalspracheEnglisch
ZeitschriftMultimedia Tools and Applications
Jahrgang79
Ausgabenummer35-36
Seiten (von - bis)26735-26746
ISSN1380-7501
DOIs
PublikationsstatusErschienen - 09.2020
Extern publiziertJa

DOI

Zuletzt angesehen

Publikationen

  1. Audio-Hacks
  2. Fallstudie
  3. Finite element modeling of laser beam welding for residual stress calculation
  4. A holistic view on security and collaboration in safe space
  5. Sustainable Consumption - Mapping the Terrain
  6. Requests for mathematical reasoning in textbooks for primary-level students
  7. I&EC 18-Small particle size magnesium in one-pot Grignard-Zerewitinoff reactions: Kinetics of and practical application to reductive dechlorination of persistent organic pollutants
  8. Development and validation of the Later Life Work Index for successful management of an aging workforce
  9. Animating embryos
  10. Achieving enhanced mechanical properties in Mg-Gd-Y-Zn-Mn alloy by altering dynamic recrystallization behavior via pre-ageing treatment
  11. Root-root interactions: extending our perspective to be more inclusive of the range of theories in ecology and agriculture using in-vivo analyses
  12. NEW CONCEPTS IN INNOVATION OUTPUT MEASUREMENT - KLEINKNECHT,A, BAIN,D
  13. Quantum computing
  14. Counteracting electric vehicle range concern with a scalable behavioural intervention
  15. Empathy as a motivator of dyadic helping across group boundaries
  16. Diversity: Konzept. Programmatik. Praxis.
  17. Categorizing urban tasks
  18. The Bumpy Road from Investigation to Knowledge
  19. The Politics of (Non)Knowledge in the (Un)Making of Migration
  20. Function, flexibility, and responsibility
  21. A Bayesian EAP-Based Nonlinear Extension of Croon and Van Veldhoven’s Model for Analyzing Data from Micro–Macro Multilevel Designs
  22. Action Learning
  23. Addressing Sufficiency
  24. Continous preventive diagnosis for cardiovascular diseases based on stochastic modeling
  25. Data quality assessment framework for critical raw materials. The case of cobalt
  26. Exports and productivity growth
  27. Identification of floodplain contamination hot spots by reconstructing Elbe river pollution load history and high flood sediment distribution during inundation.
  28. Effect of Planning for Connectivity on Linear Reserve Networks
  29. Optical part measuring inside a milling machine
  30. Recontextualizing context
  31. Sustainability in Business: Integrated Management of Value Creation and Disvalue Mitigation
  32. Fürsorge oder Selbstbestimmung?
  33. Systematic learning in water governance: insights from five local adaptive management projects for water quality innovation