Hands in Focus: Sign Language Recognition Via Top-Down Attention

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

  • Noha Sarhan
  • Christian Wilms
  • Vanessa Closius
  • Ulf Brefeld
  • Simone Frintrop

In this paper, we propose a novel Sign Language Recognition (SLR) model that leverages the task-specific knowledge to incorporate Top-Down (TD) attention to focus the processing of the network on the most relevant parts of the input video sequence. For SLR, this includes information about the hands' shape, orientation and positions, and motion trajectory. Our model consists of three streams that process RGB, optical flow and TD attention data. For the TD attention, we generate pixel-precise attention maps focusing on both hands, thereby retaining valuable hand information, while eliminating distracting background information. Our proposed method outperforms state-of-the-art on a challenging large-scale dataset by over 2%, and achieves strong results with a much simpler architecture compared to other systems on the newly released AUTSL dataset [1].

OriginalspracheEnglisch
Titel2023 IEEE International Conference on Image Processing, ICIP 2023 - Proceedings : Proceedings
Anzahl der Seiten5
ErscheinungsortPiscataway
VerlagIEEE Electromagnetic Compatibility Society
Erscheinungsdatum08.10.2023
Seiten2555-2559
ISBN (Print)978-1-7281-9836-1
ISBN (elektronisch)978-1-7281-9835-4
DOIs
PublikationsstatusErschienen - 08.10.2023
Veranstaltung2023 IEEE International Conference on Image Processing - Kuala Lumpur Convention Centre, Kuala Lumpur, Malaysia
Dauer: 08.10.202311.10.2023
Konferenznummer: 30
https://2023.ieeeicip.org/

Bibliographische Notiz

Publisher Copyright:
© 2023 IEEE.

DOI

Zuletzt angesehen

Publikationen

  1. Spanish-speaking caregivers’ use of referential labels with toddlers is a better predictor of later vocabulary than their use of referential gestures
  2. Time Use and Time Budgets
  3. Present knowledge and need for further research
  4. Understanding the diffusion of domestic biogas technologies.
  5. Article 15 Scope of the Law Applicable
  6. "Learning by doing"
  7. Intermediate `time-spaces' - The rediscovery of transition in spatial planning and environmental planning
  8. Rebound-Effekte
  9. Live Sports, Piracy and Uncertainty: Understanding Illegal Streaming Aggregation Platforms
  10. Exploring the motivations of protesters in contingent valuation
  11. External rotation of the auditor
  12. Sensor Measures of Affective Leaning
  13. Prologue: Analyzing the Fine Details of Political Commitment
  14. Systemanalyse für Softwaresysteme
  15. Timing and fragmentation of daily working hours arrangements and income inequality
  16. Does board composition have an impact on CSR reporting?
  17. Appreciating ecological complexity
  18. Maschinenbelegungsplanung mit evolutionären Algorithmen
  19. What goes around, comes around? Access and allocation problems in Global North-South waste trade
  20. Schrogl, Kai-Uwe (et. al.), Handbook of Space Security - Policies, Applications and Programs, Springer, 2015
  21. Economic Evaluation of an Internet-Based Stress Management Intervention Alongside a Randomized Controlled Trial
  22. Governance approaches to address scale issues in biodiversity management – current situation and ways forward
  23. Variable annuities and the option to seek risk
  24. Making professors
  25. Impact of audit committees with independent financial experts on accounting quality
  26. Integration of expertise or collaborative practice?
  27. Bifurcation loads of circular curved beams of glued-laminated timber with continuous lateral support
  28. Hot deformation behavior and processing map of Mg-3Sn-2Ca-0.4Al-0.4Zn alloy
  29. Fieldwork meets crisis: Introduction
  30. Response to David B. Brooks
  31. Social network activities as a predictor for phase transitions of patients with bipolar affective disorders
  32. "alterNature" in Drew Hayden Taylor’s The Berlin Blues. Construction and De(con)struction of Contested Spaces
  33. Determinants and Consequences of Executive Compensation-Related Shareholder Activism and Say-on-Pay Votes
  34. Reinforcing Systems of Exclusion