Neural relational inference for disaster multimedia retrieval

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

Events around the world are increasingly documented on social media, especially by the people experiencing them, as these platforms become more popular over time. As a consequence, social media turns into a valuable source of data for understanding those events. Due to their destructive potential, natural disasters are among events of particular interest to response operations and environmental monitoring agencies. However, this amount of information also makes it challenging to identify relevant content pertaining to those events. In this paper, we use a relational neural network model for identifying this type of content. The model is particularly suitable for unstructured text, that is, text with no particular arrangement of words, such as tags, which is commonplace in social media data. In addition, our method can be combined with a CNN for handling multimodal data where text and visual data are available. We perform experiments in three different scenarios, where different modalities are evaluated: visual, textual, and both. Our method achieves competitive performance in both modalities by themselves, while significantly outperforms the baseline on the multimodal scenario. We also demonstrate the behavior of the proposed method in different applications by performing additional experiments in the CUB-200-2011 multimodal dataset.

OriginalspracheEnglisch
ZeitschriftMultimedia Tools and Applications
Jahrgang79
Ausgabenummer35-36
Seiten (von - bis)26735-26746
ISSN1380-7501
DOIs
PublikationsstatusErschienen - 09.2020
Extern publiziertJa

DOI

Zuletzt angesehen

Publikationen

  1. A Two-Stage Sliding-Mode High-Gain Observer to Reduce Uncertainties and Disturbances Effects for Sensorless Control in Automotive Applications
  2. Deeper Insights into Different Consumer Perceptions of CSR Communication
  3. Development and comparison of processing maps of Mg-3Sn-1Ca alloy from data obtained in tension versus compression
  4. The Replication Database: Documenting the Replicability of Psychological Science
  5. Systematic feature evaluation for gene name recognition
  6. Determinants of union membership in 18 EU countries
  7. How Differences in Ratings of Odors and Odor Labels Are Associated with Identification Mechanisms
  8. Determining Lot Sizes in Production Areas
  9. A high-resolution approach for the spatiotemporal analysis of forest canopy space using terrestrial laser scanning data
  10. Towards a Comprehensive Framework for Environmental Management Accounting
  11. The buffering effect of selection, optimization, and compensation strategy use on the relationship between problem solving demands and occupational well-being
  12. Effects of accuracy feedback on fractal characteristics of time estimation
  13. TANGO: A reliable, open-source, browser-based task to assess individual differences in gaze understanding in 3 to 5-year-old children and adults
  14. Efficacy of an internet and app-based gratitude intervention in reducing repetitive negative thinking and mechanisms of change in the intervention's effect on anxiety and depression
  15. Using an adaptive memory strategy to improve a multistart heuristic for sequencing by hybridization