Sleep-like slow oscillations improve image classification through synaptic homeostasis and memory association in a thalamo-cortical model

10/24/2018
by   Cristiano Capone, et al.
0

The occurrence of sleep passed through the evolutionary sieve and is widespread in animal species. Sleep is known to be beneficial to cognitive and mnemonic tasks, while chronic sleep deprivation is detrimental. Despite the importance of the phenomenon, a theoretical and computational approach demonstrating the underlying mechanisms is still lacking. In this paper, we show interesting effects of deep-sleep-like slow oscillation activity on a simplified thalamo-cortical model which is trained to encode, retrieve and classify images of handwritten digits. During slow oscillations, spike-timing-dependent-plasticity (STDP) produces a differential homeostatic process. It is characterized by both a specific unsupervised enhancement of connections among groups of neurons associated to instances of the same class (digit) and a simultaneous down-regulation of stronger synapses created by the training. This is reflected in a hierarchical organization of post-sleep internal representations. Such effects favour higher performances in retrieval and classification tasks and create hierarchies of categories in integrated representations. The model leverages on the interaction between of top-down cortico-thalamic predictions and bottom-up thalamo-cortical projections during deep-sleep-like slow oscillations. Such mechanism hints at possible applications to artificial learning systems.

READ FULL TEXT
research
10/24/2018

Sleep-like slow oscillations induce hierarchical memory association and synaptic homeostasis in thalamo-cortical simulations

The occurrence of sleep is widespread over the large majority of animal ...
research
11/13/2022

NREM and REM: cognitive and energetic gains in thalamo-cortical sleeping and awake spiking model

Sleep is essential for learning and cognition, but the mechanisms by whi...
research
08/01/2019

Biologically inspired sleep algorithm for artificial neural networks

Sleep plays an important role in incremental learning and consolidation ...
research
03/26/2020

Thalamo-cortical spiking model of incremental learning combining perception, context and NREM-sleep-mediated noise-resilience

The brain exhibits capabilities of fast incremental learning from few no...
research
09/10/2020

TRIER: Template-Guided Neural Networks for Robust and Interpretable Sleep Stage Identification from EEG Recordings

Neural networks often obtain sub-optimal representations during training...
research
03/18/2017

A wake-sleep algorithm for recurrent, spiking neural networks

We investigate a recently proposed model for cortical computation which ...
research
06/26/2017

μNap: Practical Micro-Sleeps for 802.11 WLANs

In this paper, we revisit the idea of putting interfaces to sleep during...

Please sign up or login with your details

Forgot password? Click here to reset