CCN GAC Workshop: Issues with learning in biological recurrent neural networks

05/12/2021
by   Luke Y. Prince, et al.
18

This perspective piece came about through the Generative Adversarial Collaboration (GAC) series of workshops organized by the Computational Cognitive Neuroscience (CCN) conference in 2020. We brought together a number of experts from the field of theoretical neuroscience to debate emerging issues in our understanding of how learning is implemented in biological recurrent neural networks. Here, we will give a brief review of the common assumptions about biological learning and the corresponding findings from experimental neuroscience and contrast them with the efficiency of gradient-based learning in recurrent neural networks commonly used in artificial intelligence. We will then outline the key issues discussed in the workshop: synaptic plasticity, neural circuits, theory-experiment divide, and objective functions. Finally, we conclude with recommendations for both theoretical and experimental neuroscientists when designing new studies that could help to bring clarity to these issues.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/09/2022

Emergent Computations in Trained Artificial Neural Networks and Real Brains

Synaptic plasticity allows cortical circuits to learn new tasks and to a...
research
06/21/2012

A biological gradient descent for prediction through a combination of STDP and homeostatic plasticity

Identifying, formalizing and combining biological mechanisms which imple...
research
07/13/2023

Learning fixed points of recurrent neural networks by reparameterizing the network model

In computational neuroscience, fixed points of recurrent neural networks...
research
11/08/2021

The Global Structure of Codimension-2 Local Bifurcations in Continuous-Time Recurrent Neural Networks

If we are ever to move beyond the study of isolated special cases in the...
research
06/09/2021

Fine-Grained System Identification of Nonlinear Neural Circuits

We study the problem of sparse nonlinear model recovery of high dimensio...
research
07/05/2023

A Versatile Hub Model For Efficient Information Propagation And Feature Selection

Hub structure, characterized by a few highly interconnected nodes surrou...
research
11/10/2016

Proceedings of the Workshop on Brain Analysis using COnnectivity Networks - BACON 2016

Understanding brain connectivity in a network-theoretic context has show...

Please sign up or login with your details

Forgot password? Click here to reset