Exploiting Oxide Based Resistive RAM Variability for Probabilistic AI Hardware Design

by   Akul Malhotra, et al.
Penn State University

Uncertainty plays a key role in real-time machine learning. As a significant shift from standard deep networks, which does not consider any uncertainty formulation during its training or inference, Bayesian deep networks are being currently investigated where the network is envisaged as an ensemble of plausible models learnt by the Bayes' formulation in response to uncertainties in sensory data. Bayesian deep networks consider each synaptic weight as a sample drawn from a probability distribution with learnt mean and variance. This paper elaborates on a hardware design that exploits cycle-to-cycle variability of oxide based Resistive Random Access Memories (RRAMs) as a means to realize such a probabilistic sampling function, instead of viewing it as a disadvantage.


page 1

page 2

page 3

page 4


Exploiting Oxide Based Resistive RAM Variability for Bayesian Neural Network Hardware Design

Uncertainty plays a key role in real-time machine learning. As a signifi...

Bayesian Neural Networks for Reversible Steganography

Recent advances in deep learning have led to a paradigm shift in reversi...

Understanding over-parameterized deep networks by geometrization

A complete understanding of the widely used over-parameterized deep netw...

Adaptive, Distribution-Free Prediction Intervals for Deep Neural Networks

This paper addresses the problem of assessing the variability of predict...

Locally Learned Synaptic Dropout for Complete Bayesian Inference

The Bayesian brain hypothesis postulates that the brain accurately opera...

Lightweight Probabilistic Deep Networks

Even though probabilistic treatments of neural networks have a long hist...

Bayesian Neural Networks

This paper describes and discusses Bayesian Neural Network (BNN). The pa...

Please sign up or login with your details

Forgot password? Click here to reset