Equilibrium Propagation for Complete Directed Neural Networks

06/15/2020
by   Matilde Tristany Farinha, et al.
2

Artificial neural networks, one of the most successful approaches to supervised learning, were originally inspired by their biological counterparts. However, the most successful learning algorithm for artificial neural networks, backpropagation, is considered biologically implausible. We contribute to the topic of biologically plausible neuronal learning by building upon and extending the equilibrium propagation learning framework. Specifically, we introduce: a new neuronal dynamics and learning rule for arbitrary network architectures; a sparsity-inducing method able to prune irrelevant connections; a dynamical-systems characterization of the models, using Lyapunov theory.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/20/2021

On the relationship between predictive coding and backpropagation

Artificial neural networks are often interpreted as abstract models of b...
research
09/25/2016

Learning by Stimulation Avoidance: A Principle to Control Spiking Neural Networks Dynamics

Learning based on networks of real neurons, and by extension biologicall...
research
03/09/2021

A Gradient Estimator for Time-Varying Electrical Networks with Non-Linear Dissipation

We propose a method for extending the technique of equilibrium propagati...
research
10/27/2021

Latent Equilibrium: A unified learning theory for arbitrarily fast computation with arbitrarily slow neurons

The response time of physical computational elements is finite, and neur...
research
04/08/2022

Biologically-inspired neuronal adaptation improves learning in neural networks

Since humans still outperform artificial neural networks on many tasks, ...
research
06/11/2020

GAIT-prop: A biologically plausible learning rule derived from backpropagation of error

Traditional backpropagation of error, though a highly successful algorit...
research
11/29/2019

MSTDP: A More Biologically Plausible Learning

Spike-timing dependent plasticity (STDP) which observed in the brain has...

Please sign up or login with your details

Forgot password? Click here to reset