Hands in Focus: Sign Language Recognition Via Top-Down Attention

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

  • Noha Sarhan
  • Christian Wilms
  • Vanessa Closius
  • Ulf Brefeld
  • Simone Frintrop

In this paper, we propose a novel Sign Language Recognition (SLR) model that leverages the task-specific knowledge to incorporate Top-Down (TD) attention to focus the processing of the network on the most relevant parts of the input video sequence. For SLR, this includes information about the hands' shape, orientation and positions, and motion trajectory. Our model consists of three streams that process RGB, optical flow and TD attention data. For the TD attention, we generate pixel-precise attention maps focusing on both hands, thereby retaining valuable hand information, while eliminating distracting background information. Our proposed method outperforms state-of-the-art on a challenging large-scale dataset by over 2%, and achieves strong results with a much simpler architecture compared to other systems on the newly released AUTSL dataset [1].

OriginalspracheEnglisch
Titel2023 IEEE International Conference on Image Processing, ICIP 2023 - Proceedings : Proceedings
Anzahl der Seiten5
ErscheinungsortPiscataway
VerlagIEEE Electromagnetic Compatibility Society
Erscheinungsdatum08.10.2023
Seiten2555-2559
ISBN (Print)978-1-7281-9836-1
ISBN (elektronisch)978-1-7281-9835-4
DOIs
PublikationsstatusErschienen - 08.10.2023
Veranstaltung2023 IEEE International Conference on Image Processing - Kuala Lumpur Convention Centre, Kuala Lumpur, Malaysia
Dauer: 08.10.202311.10.2023
Konferenznummer: 30
https://2023.ieeeicip.org/

Bibliographische Notiz

Publisher Copyright:
© 2023 IEEE.

DOI

Zuletzt angesehen

Publikationen

  1. The influence of vertical integration and property rights on network access charges in the German electricity market
  2. Comparing apples with oranges? An approach to link TIMSS and the National Educational Panel Study in Germany via equipercentile and IRT methods
  3. Thermal synthesis of a thermochemical heat storage with heat exchanger optimization
  4. Success factors in Balanced Scorecard implementations
  5. Zapping-Fernbedienung
  6. D2R2 2024: Linked Data-driven Resilience Research 2024
  7. Simultaneous Determination of 11 Sulfonamides by HPLC–UV and Application for Fast Screening of Their Aerobic Elimination and Biodegradation in a Simple Test
  8. Symbole unserer Zeit und ihre formierenden Elemente
  9. Bifurcation loads of circular curved beams of glued-laminated timber with continuous lateral support
  10. Scope of the book wastewater reuse and current challenges
  11. Getting an empirical hold of the sustainable university
  12. Supporting Diffusion of IoT Solutions Exemplified by the ChainPORT Initiative
  13. Single photoproduction of η-mesons of hydrogen in the forward direction at 4 and 6 GeV
  14. Comedy of Deviation: Tamar Getter's Hēliotropion Cycle
  15. Loopdiver
  16. Moving beyond unlearning unsustainable consumption
  17. Maintaining the impact of action-oriented entrepreneurship training
  18. Zielablösezyklus
  19. Light treatment of a complex problem
  20. Accumulation and Subjectivity
  21. Trainingslehre - Aufwärmen : Stretchen: ja oder nein?
  22. Bats in a Farming Landscape Benefit from Linear Remnants and Unimproved Pastures
  23. On the way to greener ionic liquids
  24. Climate change and environmental hazards related to shipping
  25. Monitoring mental stressors at work with the work health audit instrument factors
  26. Biomass Composition of Blue Mussels, Mytilus edulis, is Affected by Living Site and Species of Ingested Microalgae
  27. A Reconsideration of the Perfect-Competition Model
  28. Top-down social modulation of perception-action coupling
  29. Relative and absolute scarcity of nature
  30. Double trouble
  31. Rethinking Gamification
  32. One Size fits None
  33. Litigation without end? The deutsche telekom case and the german approach to private enforcement of securities law
  34. Austria