Boost Event-Driven Tactile Learning with Location Spiking Neurons

by   Peng Kang, et al.

Tactile sensing is essential for a variety of daily tasks. And recent advances in event-driven tactile sensors and Spiking Neural Networks (SNNs) spur the research in related fields. However, SNN-enabled event-driven tactile learning is still in its infancy due to the limited representation abilities of existing spiking neurons and high spatio-temporal complexity in the event-driven tactile data. In this paper, to improve the representation capability of existing spiking neurons, we propose a novel neuron model called "location spiking neuron", which enables us to extract features of event-based data in a novel way. Specifically, based on the classical Time Spike Response Model (TSRM), we develop the Location Spike Response Model (LSRM). In addition, based on the most commonly-used Time Leaky Integrate-and-Fire (TLIF) model, we develop the Location Leaky Integrate-and-Fire (LLIF) model. Moreover, to demonstrate the representation effectiveness of our proposed neurons and capture the complex spatio-temporal dependencies in the event-driven tactile data, we exploit the location spiking neurons to propose two hybrid models for event-driven tactile learning. Specifically, the first hybrid model combines a fully-connected SNN with TSRM neurons and a fully-connected SNN with LSRM neurons. And the second hybrid model fuses the spatial spiking graph neural network with TLIF neurons and the temporal spiking graph neural network with LLIF neurons. Extensive experiments demonstrate the significant improvements of our models over the state-of-the-art methods on event-driven tactile learning. Moreover, compared to the counterpart artificial neural networks (ANNs), our SNN models are 10x to 100x energy-efficient, which shows the superior energy efficiency of our models and may bring new opportunities to the spike-based learning community and neuromorphic engineering.


page 1

page 7

page 15


Event-Driven Tactile Learning with Location Spiking Neurons

The sense of touch is essential for a variety of daily tasks. New advanc...

Community detection with spiking neural networks for neuromorphic hardware

We present results related to the performance of an algorithm for commun...

TactileSGNet: A Spiking Graph Neural Network for Event-based Tactile Object Recognition

Tactile perception is crucial for a variety of robot tasks including gra...

A Fully Spiking Hybrid Neural Network for Energy-Efficient Object Detection

This paper proposes a Fully Spiking Hybrid Neural Network (FSHNN) for en...

Even Faster SNN Simulation with Lazy+Event-driven Plasticity and Shared Atomics

We present two novel optimizations that accelerate clock-based spiking n...

Learning Event-based Spatio-Temporal Feature Descriptors via Local Synaptic Plasticity: A Biologically-Plausible Perspective of Computer Vision

We present an optimization-based theory describing spiking cortical ense...

Spiking Neural Networks with Single-Spike Temporal-Coded Neurons for Network Intrusion Detection

Spiking neural network (SNN) is interesting due to its strong bio-plausi...

Please sign up or login with your details

Forgot password? Click here to reset