Visualizing the Hidden Activity of Artificial Neural Networks

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

In machine learning, pattern classification assigns high-dimensional vectors (observations) to classes based on generalization from examples. Artificial neural networks currently achieve state-of-the-art results in this task. Although such networks are typically used as black-boxes, they are also widely believed to learn (high-dimensional) higher-level representations of the original observations. In this paper, we propose using dimensionality reduction for two tasks: visualizing the relationships between learned representations of observations, and visualizing the relationships between artificial neurons. Through experiments conducted in three traditional image classification benchmark datasets, we show how visualization can provide highly valuable feedback for network designers. For instance, our discoveries in one of these datasets (SVHN) include the presence of interpretable clusters of learned representations, and the partitioning of artificial neurons into groups with apparently related discriminative roles.

OriginalspracheEnglisch
Aufsatznummer7539329
ZeitschriftIEEE Transactions on Visualization and Computer Graphics
Jahrgang23
Ausgabenummer1
Seiten (von - bis)101-110
Anzahl der Seiten10
ISSN1077-2626
DOIs
PublikationsstatusErschienen - 01.2017
Extern publiziertJa

DOI

Zuletzt angesehen

Publikationen

  1. Using conditional inference trees and random forests to predict the bioaccumulation potential of organic chemicals
  2. An Adaptive and Optimized Switching Observer for Sensorless Control of an Electromagnetic Valve Actuator in Camless Internal Combustion Engines
  3. Obstacle Coordinates Transformation from TVS Body-Frame to AGV Navigation-Frame
  4. A Sliding Mode Control with a Bang-Bang Observer for Detection of Particle Pollution
  5. Modeling Grounding Processes in Chat-based CSCL
  6. Machine Learning and Data Mining for Sports Analytics
  7. The Lifecycle of "Facts'': A Survey of Social Bias in Knowledge Graphs
  8. Applied Conversation Analysis in Foreign Language Didactics
  9. A Hermeneutic Interpretation of Concepts in a Cooperative Multicultural Working Project
  10. Internal forces in robotic manipulation and in general mechanisms using a geometric approach
  11. Phase Shift APOD and POD Control Technique in Multi-Level Inverters to Mitigate Total Harmonic Distortion
  12. Entangled – But How?
  13. Reducing the peaking phenomenon in Luenberger observers in presence of quasi-static disturbances for linear time invariant systems
  14. Local responses to global technological change.
  15. Magnesium-based metal matrix nanocomposites—processing and properties
  16. Forging of cast Mg-3Sn-2Ca-0.4Al-0.4Si magnesium alloy using processing map
  17. Vergütung, variable
  18. Is implicit Theory of Mind real but hard to detect?
  19. Improving efficiency in budgeting
  20. OPERATIONALIZING DIGITAL TRANSFORMATION FROM MULTIPLE PERSPECTIVES
  21. Multi-agent systems' asset for smart grid applications
  22. Enhancing Community Interactions with Data-Driven Chatbots - The DBpedia Chatbot
  23. Collaboration and Open Science Initiatives in Primate Research
  24. Developmentalities and donor-NGO relations
  25. Introduction
  26. Trust in scientists, risk perception, conspiratorial beliefs, and unrealistic optimism
  27. AUC Maximizing Support Vector Learning
  28. Series foreword of Series Editors
  29. Group formation in computer-supported collaborative learning
  30. Homogenization approach based on laminates
  31. Substance Flows Associated with Medical Care - Significance of Different Sources
  32. Manual construction and mathematics- and computer-aided counting of stereoisomers. The example of oligoinositols
  33. Responsibility and environment
  34. Rational Design of Molecules by Life Cycle Engineering
  35. New Methods for the Analysis of Links between International Firm Activities and Firm Performance: A Practitioner’s Guide
  36. Introduction
  37. Learning and Re-learning in Chat-based CSCL
  38. Navigating pluralism
  39. Embedded, not plugged-in
  40. Transcending the Locality of Grassroots Initiatives
  41. Data quality assessment framework for critical raw materials. The case of cobalt
  42. Qualitative and Quantitative Human Error Analysis in Hazardous Industries
  43. Mathematical Model of Double Row Self-Aligning Ball Bearing
  44. Assembly history modulates vertical root distribution in a grassland experiment
  45. How to measure the substantive representation of traditionally excluded groups in comparative research
  46. Concept Maps in der Hochschullehre
  47. Introduction to Kant's Anthropology