On 1/n neural representation and robustness

by   Josue Nassar, et al.

Understanding the nature of representation in neural networks is a goal shared by neuroscience and machine learning. It is therefore exciting that both fields converge not only on shared questions but also on similar approaches. A pressing question in these areas is understanding how the structure of the representation used by neural networks affects both their generalization, and robustness to perturbations. In this work, we investigate the latter by juxtaposing experimental results regarding the covariance spectrum of neural representations in the mouse V1 (Stringer et al) with artificial neural networks. We use adversarial robustness to probe Stringer et al's theory regarding the causal role of a 1/n covariance spectrum. We empirically investigate the benefits such a neural code confers in neural networks, and illuminate its role in multi-layer architectures. Our results show that imposing the experimentally observed structure on artificial neural networks makes them more robust to adversarial attacks. Moreover, our findings complement the existing theory relating wide neural networks to kernel methods, by showing the role of intermediate representations.


page 4

page 5

page 8

page 10

page 11

page 15

page 16

page 19


Disentangling Improves VAEs' Robustness to Adversarial Attacks

This paper is concerned with the robustness of VAEs to adversarial attac...

Overparametrization improves robustness against adversarial attacks: A replication study

Overparametrization has become a de facto standard in machine learning. ...

Isometric Representations in Neural Networks Improve Robustness

Artificial and biological agents cannon learn given completely random an...

Wavelets Beat Monkeys at Adversarial Robustness

Research on improving the robustness of neural networks to adversarial n...

Optimal input representation in neural systems at the edge of chaos

Shedding light onto how biological systems represent, process and store ...

Different Spectral Representations in Optimized Artificial Neural Networks and Brains

Recent studies suggest that artificial neural networks (ANNs) that match...

Ablation Studies in Artificial Neural Networks

Ablation studies have been widely used in the field of neuroscience to t...

Please sign up or login with your details

Forgot password? Click here to reset