Interpretation of ResNet by Visualization of Preferred Stimulus in Receptive Fields

06/02/2020
by   Genta Kobayashi, et al.
0

One of the methods used in image recognition is the Deep Convolutional Neural Network (DCNN). DCNN is a model in which the expressive power of features is greatly improved by deepening the hidden layer of CNN. The architecture of CNNs is determined based on a model of the visual cortex of mammals. There is a model called Residual Network (ResNet) that has a skip connection. ResNet is an advanced model in terms of the learning method, but it has no biological viewpoint. In this research, we investigate the receptive fields of a ResNet on the classification task in ImageNet. We find that ResNet has orientation selective neurons and double opponent color neurons. In addition, we suggest that some inactive neurons in the first layer of ResNet effect for the classification task.

READ FULL TEXT

page 7

page 8

page 9

research
05/19/2017

What are the Receptive, Effective Receptive, and Projective Fields of Neurons in Convolutional Neural Networks?

In this work, we explain in detail how receptive fields, effective recep...
research
04/21/2018

Study of Residual Networks for Image Recognition

Deep neural networks demonstrate to have a high performance on image cla...
research
05/27/2023

On the special role of class-selective neurons in early training

It is commonly observed that deep networks trained for classification ex...
research
03/15/2019

Selective Kernel Networks

In standard Convolutional Neural Networks (CNNs), the receptive fields o...
research
02/10/2022

Deep Learning in Random Neural Fields: Numerical Experiments via Neural Tangent Kernel

A biological neural network in the cortex forms a neural field. Neurons ...
research
07/27/2017

Deep Residual Learning for Weakly-Supervised Relation Extraction

Deep residual learning (ResNet) is a new method for training very deep n...
research
12/18/2019

ResNetX: a more disordered and deeper network architecture

Designing efficient network structures has always been the core content ...

Please sign up or login with your details

Forgot password? Click here to reset