Self-supervised Siamese Autoencoders

Publikation: Beiträge in SammelwerkenAufsätze in KonferenzbändenForschungbegutachtet

Authors

  • Friederike Baier
  • Sebastian Mair
  • Samuel G. Fadel

In contrast to fully-supervised models, self-supervised representation learning only needs a fraction of data to be labeled and often achieves the same or even higher downstream performance. The goal is to pre-train deep neural networks on a self-supervised task, making them able to extract meaningful features from raw input data afterwards. Previously, autoencoders and Siamese networks have been successfully employed as feature extractors for tasks such as image classification. However, both have their individual shortcomings and benefits. In this paper, we combine their complementary strengths by proposing a new method called SidAE (Siamese denoising autoencoder). Using an image classification downstream task, we show that our model outperforms two self-supervised baselines across multiple data sets and scenarios. Crucially, this includes conditions in which only a small amount of labeled data is available. Empirically, the Siamese component has more impact, but the denoising autoencoder is nevertheless necessary to improve performance.

OriginalspracheEnglisch
TitelAdvances in Intelligent Data Analysis XXII : 22nd International Symposium on Intelligent Data Analysis, IDA 2024, Proceedings
HerausgeberIoanna Miliou, Panagiotis Papapetrou, Nico Piatkowski
Anzahl der Seiten12
VerlagSpringer Science and Business Media Deutschland
Erscheinungsdatum2024
Seiten117-128
ISBN (Print)978-3-031-58546-3
ISBN (elektronisch)978-3-031-58547-0
DOIs
PublikationsstatusErschienen - 2024
Veranstaltung22nd International Symposium on Intelligent Data Analysis - IDA 2024 - NOD building, Stockholm, Stockholm, Schweden
Dauer: 24.04.202426.04.2024
Konferenznummer: 22
http://www.wikicfp.com/cfp/servlet/event.showcfp?copyownerid=90704&eventid=176233
http://ida2024.org/

Bibliographische Notiz

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

DOI

Zuletzt angesehen

Publikationen

  1. What is missing in the EVS?
  2. Energy model, boundary object and societal lens
  3. Instruments for co-operative planning in spatial management concerned with flooding issues
  4. Towards greener and sustainable ionic liquids using naturally occurring and nature-inspired pyridinium structures
  5. From 'one right way' to 'one ruinous way'? Discursive shifts in 'There is no alternative'
  6. Effects of plyometric training on postural control in static and dynamic testing situations
  7. The lens of polycentricity
  8. Evaluating a hybrid web-based training program for panic disorder and agoraphobia
  9. Conceptualizing protected area research in a transdisciplinary
  10. Investigation of the sulfur speciation in petroleum products by capillary gas chromatography with ICP-collision cell-MS detection
  11. Mapping Urban Information as an Interdisciplinary Method for Geography, Art and Architecture Representations
  12. Material system analysis
  13. Software and Web-Based Tools for Sustainability Management in Micro-, Small- and Medium-Sized Enterprises
  14. Collisions in space
  15. A Process Perspective on Organizational Failure
  16. Social group membership does not modulate automatic imitation in a contrastive multi-agent paradigm
  17. Intelligence assessment with computer simulations
  18. Capitalizing on natural language processing (NLP) to automate the evaluation of coach implementation fidelity in guided digital cognitive-behavioral therapy (GdCBT)
  19. Rapid Prototyping of a Mechatronic Engine Valve Controller for IC Engines
  20. Constitutions, Democratic Self-Determination and the Institutional Empowerment of Future Generations: Mitigating an Aporia
  21. Ticio Escobar
  22. Resolving conflicts between people and over time in the transformation toward sustainability
  23. Lyapunov stability analysis to set up a saturating PI controller with anti-windup for a mass flow system
  24. U-model-based dynamic inversion control for quadrotor UAV systems
  25. Systematic risk behavior in cyclical industries