Exploiting Oxide Based Resistive RAM Variability for Bayesian Neural Network Hardware Design

by   Akul Malhotra, et al.
Penn State University

Uncertainty plays a key role in real-time machine learning. As a significant shift from standard deep networks, which does not consider any uncertainty formulation during its training or inference, Bayesian deep networks are being currently investigated where the network is envisaged as an ensemble of plausible models learnt by the Bayes' formulation in response to uncertainties in sensory data. Bayesian deep networks consider each synaptic weight as a sample drawn from a probability distribution with learnt mean and variance. This paper elaborates on a hardware design that exploits cycle-to-cycle variability of oxide based Resistive Random Access Memories (RRAMs) as a means to realize such a probabilistic sampling function, instead of viewing it as a disadvantage.


page 1

page 2

page 3

page 4


Exploiting Oxide Based Resistive RAM Variability for Probabilistic AI Hardware Design

Uncertainty plays a key role in real-time machine learning. As a signifi...

Bayesian Neural Networks for Reversible Steganography

Recent advances in deep learning have led to a paradigm shift in reversi...

Training Spiking Deep Networks for Neuromorphic Hardware

We describe a method to train spiking deep networks that can be run usin...

Ensembling geophysical models with Bayesian Neural Networks

Ensembles of geophysical models improve projection accuracy and express ...

Locally Learned Synaptic Dropout for Complete Bayesian Inference

The Bayesian brain hypothesis postulates that the brain accurately opera...

Bayesian Neural Networks

This paper describes and discusses Bayesian Neural Network (BNN). The pa...

Neural Sampling Machine with Stochastic Synapse allows Brain-like Learning and Inference

Many real-world mission-critical applications require continual online l...

Please sign up or login with your details

Forgot password? Click here to reset