Hardware Implementation of Spiking Neural Networks Using Time-To-First-Spike Encoding

06/09/2020
by   Seongbin Oh, et al.
0

Hardware-based spiking neural networks (SNNs) are regarded as promising candidates for the cognitive computing system due to low power consumption and highly parallel operation. In this work, we train the SNN in which the firing time carries information using temporal backpropagation. The temporally encoded SNN with 512 hidden neurons showed an accuracy of 96.90 set. Furthermore, the effect of the device variation on the accuracy in temporally encoded SNN is investigated and compared with that of the rate-encoded network. In a hardware configuration of our SNN, NOR-type analog memory having an asymmetric floating gate is used as a synaptic device. In addition, we propose a neuron circuit including a refractory period generator for temporally encoded SNN. The performance of the 2-layer neural network consisting of synapses and proposed neurons is evaluated through circuit simulation using SPICE. The network with 128 hidden neurons showed an accuracy of 94.9 MNIST dataset. Finally, the latency and power consumption of each block constituting the temporal network is analyzed and compared with those of the rate-encoded network depending on the total time step. Assuming that the total time step number of the network is 256, the temporal network consumes 15.12 times lower power than the rate-encoded network and can make decisions 5.68 times faster.

READ FULL TEXT

page 14

page 20

research
01/05/2022

Improving Spiking Neural Network Accuracy Using Time-based Neurons

Due to the fundamental limit to reducing power consumption of running de...
research
07/30/2019

Temporal coding in spiking neural networks with alpha synaptic function

The timing of individual neuronal spikes is essential for biological bra...
research
06/12/2020

Training spiking multi-layer networks with surrogate gradients on an analog neuromorphic substrate

Spiking neural networks are nature's solution for parallel information p...
research
10/06/2021

Spike-inspired Rank Coding for Fast and Accurate Recurrent Neural Networks

Biological spiking neural networks (SNNs) can temporally encode informat...
research
12/24/2015

Hardware Architecture for Large Parallel Array of Random Feature Extractors applied to Image Recognition

We demonstrate a low-power and compact hardware implementation of Random...
research
06/03/2020

You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy

In the past decade, advances in Artificial Neural Networks (ANNs) have a...
research
11/27/2020

A Temporal Neural Network Architecture for Online Learning

A long-standing proposition is that by emulating the operation of the br...

Please sign up or login with your details

Forgot password? Click here to reset