Recurrent Attention Model with Log-Polar Mapping is Robust against Adversarial Attacks

02/13/2020
by   Taro Kiritani, et al.
0

Convolutional neural networks are vulnerable to small ℓ^p adversarial attacks, while the human visual system is not. Inspired by neural networks in the eye and the brain, we developed a novel artificial neural network model that recurrently collects data with a log-polar field of view that is controlled by attention. We demonstrate the effectiveness of this design as a defense against SPSA and PGD adversarial attacks. It also has beneficial properties observed in the animal visual system, such as reflex-like pathways for low-latency inference, fixed amount of computation independent of image size, and rotation and scale invariance. The code for experiments is available at https://gitlab.com/exwzd-public/kiritani_ono_2020.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/31/2019

Training Artificial Neural Networks by Generalized Likelihood Ratio Method: Exploring Brain-like Learning to Improve Adversarial Defensiveness

Recent work in deep learning has shown that the artificial neural networ...
research
11/03/2021

Multi-Glimpse Network: A Robust and Efficient Classification Architecture based on Recurrent Downsampled Attention

Most feedforward convolutional neural networks spend roughly the same ef...
research
10/27/2022

BI AVAN: Brain inspired Adversarial Visual Attention Network

Visual attention is a fundamental mechanism in the human brain, and it i...
research
11/24/2018

Attention, Please! Adversarial Defense via Attention Rectification and Preservation

This study provides a new understanding of the adversarial attack proble...
research
11/04/2022

Adversarial Defense via Neural Oscillation inspired Gradient Masking

Spiking neural networks (SNNs) attract great attention due to their low ...
research
11/21/2021

Denoised Internal Models: a Brain-Inspired Autoencoder against Adversarial Attacks

Despite its great success, deep learning severely suffers from robustnes...
research
11/11/2020

Adversarial images for the primate brain

Deep artificial neural networks have been proposed as a model of primate...

Please sign up or login with your details

Forgot password? Click here to reset