EasyConvPooling: Random Pooling with Easy Convolution for Accelerating Training and Testing

06/05/2018
by   Jianzhong Sheng, et al.
0

Convolution operations dominate the overall execution time of Convolutional Neural Networks (CNNs). This paper proposes an easy yet efficient technique for both Convolutional Neural Network training and testing. The conventional convolution and pooling operations are replaced by Easy Convolution and Random Pooling (ECP). In ECP, we randomly select one pixel out of four and only conduct convolution operations of the selected pixel. As a result, only a quarter of the conventional convolution computations are needed. Experiments demonstrate that the proposed EasyConvPooling can achieve 1.45x speedup on training time and 1.64x on testing time. What's more, a speedup of 5.09x on pure Easy Convolution operations is obtained compared to conventional convolution operations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/03/2021

An Alternative Practice of Tropical Convolution to Traditional Convolutional Neural Networks

Convolutional neural networks (CNNs) have been used in many machine lear...
research
09/06/2019

HNMTP Conv: Optimize Convolution Algorithm for Single-Image Convolution Neural Network Inference on Mobile GPUs

Convolution neural networks are widely used for mobile applications. How...
research
03/05/2019

HexagDLy - Processing hexagonally sampled data with CNNs in PyTorch

HexagDLy is a Python-library extending the PyTorch deep learning framewo...
research
05/09/2019

Convolutional Neural Networks Utilizing Multifunctional Spin-Hall MTJ Neurons

We propose a new network architecture for standard spin-Hall magnetic tu...
research
03/11/2016

Efficient forward propagation of time-sequences in convolutional neural networks using Deep Shifting

When a Convolutional Neural Network is used for on-the-fly evaluation of...
research
10/27/2017

Convolutional Neural Networks Via Node-Varying Graph Filters

Convolutional neural networks (CNNs) are being applied to an increasing ...
research
07/31/2015

Flip-Rotate-Pooling Convolution and Split Dropout on Convolution Neural Networks for Image Classification

This paper presents a new version of Dropout called Split Dropout (sDrop...

Please sign up or login with your details

Forgot password? Click here to reset