research
∙
12/19/2021
Logarithmic Unbiased Quantization: Practical 4-bit Training in Deep Learning
Quantization of the weights and activations is one of the main methods t...
share
research
∙
02/16/2021
Accelerated Sparse Neural Training: A Provable and Efficient Method to Find N:M Transposable Masks
Recently, researchers proposed pruning deep neural network weights (DNNs...
research
∙
06/15/2020
Neural gradients are lognormally distributed: understanding sparse and quantized training
Neural gradient compression remains a main bottleneck in improving train...
research
∙
02/18/2020
