Visualizing the Hidden Activity of Artificial Neural Networks

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

In machine learning, pattern classification assigns high-dimensional vectors (observations) to classes based on generalization from examples. Artificial neural networks currently achieve state-of-the-art results in this task. Although such networks are typically used as black-boxes, they are also widely believed to learn (high-dimensional) higher-level representations of the original observations. In this paper, we propose using dimensionality reduction for two tasks: visualizing the relationships between learned representations of observations, and visualizing the relationships between artificial neurons. Through experiments conducted in three traditional image classification benchmark datasets, we show how visualization can provide highly valuable feedback for network designers. For instance, our discoveries in one of these datasets (SVHN) include the presence of interpretable clusters of learned representations, and the partitioning of artificial neurons into groups with apparently related discriminative roles.

OriginalspracheEnglisch
Aufsatznummer7539329
ZeitschriftIEEE Transactions on Visualization and Computer Graphics
Jahrgang23
Ausgabenummer1
Seiten (von - bis)101-110
Anzahl der Seiten10
ISSN1077-2626
DOIs
PublikationsstatusErschienen - 01.2017
Extern publiziertJa

DOI

Zuletzt angesehen

Publikationen

  1. Q-Adaptive Control of the nonlinear dynamics of the cantilever-sample system of an Atomic Force Microscope
  2. Distributed robust Gaussian Process regression
  3. Gamma GAMM applied on tree growth data
  4. Effects of an expressive writing intervention (EWI) with women treated for breast cancer explored with recurrence quantification analysis (RQA) of changes in text structure - a proof-of-concept study
  5. The Challenge of Democratic Representation in the European Union
  6. Advanced extrusion processes
  7. The Role of Zn Additions on the Microstructure and Mechanical Properties of Mg–Nd–Zn Alloys
  8. Visions of Process—Swarm Intelligence and Swarm Robotics in Architectural Design and Construction
  9. Bulk and local textures of pure magnesium processed by rotary swaging
  10. ZooKeys, unlocking Earth's incredible biodiversity and building a sustainable bridge into the public domain: From "print-based" to "web-based" taxonomy, systematics, and natural history ZooKeys Editorial Opening Paper
  11. Grüne Parteien
  12. Trust in scientists, risk perception, conspiratorial beliefs, and unrealistic optimism
  13. A Method to Enhance the Accuracy of Time of Flight Measurement Systems
  14. Manual construction and mathematics- and computer-aided counting of stereoisomers. The example of oligoinositols
  15. Rational Design of Molecules by Life Cycle Engineering
  16. New Methods for the Analysis of Links between International Firm Activities and Firm Performance: A Practitioner’s Guide
  17. HPLC and chemometrics-assisted UV-spectroscopy methods for the simultaneous determination of ambroxol and doxycycline in capsule.
  18. Recontextualizing context
  19. Succession in respect of cession, unification and separation of States.
  20. Concept Maps in der Hochschullehre
  21. Microstructural approaches of engineering materials
  22. Life-protecting neoliberalism
  23. Comments on Hasenfeld and Gidron
  24. The Island of the Day After.
  25. Value co-creation through collective intelligence in the public sector
  26. The professional identity of gameworkers revisited
  27. Lifestyle-TV – Critical Attitudes towards „Banal” Programming
  28. Towards a socio-cognitive approach to knowledge transfer
  29. Introducing the MusicLab Copenhagen Dataset
  30. In situ investigation of microstructure evolution during solidification of Mg10CaxGd (x = 5, 10, 20) alloys
  31. [U]topische Körper in der Adoleszenz
  32. Analytical model to determine the strength of form-fit connection joined by die-less hydroforming
  33. One Fits Them All?
  34. Ion release from magnesium materials in physiological solutions under different oxygen tensions
  35. Computer-based Adaptive Speed Tests
  36. Lernen und Wiederlernen in chatbasiertem Computer-Supported Collaborative Learning