Learning Multiplication-free Linear Transformations

12/09/2018
by   Cristian Rusu, et al.
0

In this paper, we propose several dictionary learning algorithms for sparse representations that also impose specific structures on the learned dictionaries such that they are numerically efficient to use: reduced number of addition/multiplications and even avoiding multiplications altogether. We base our work on factorizations of the dictionary in highly structured basic building blocks (binary orthonormal, scaling and shear transformations) for which we can write closed-form solutions to the optimization problems that we consider. We show the effectiveness of our methods on image data where we can compare against well-known numerically efficient transforms such as the fast Fourier and the fast discrete cosine transforms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/22/2020

Constructing fast approximate eigenspaces with application to the fast graph Fourier transforms

We investigate numerically efficient approximations of eigenspaces assoc...
research
03/14/2019

Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations

Fast linear transforms are ubiquitous in machine learning, including the...
research
07/15/2020

Group Invariant Dictionary Learning

The dictionary learning problem concerns the task of representing data a...
research
06/12/2018

Fast Rotational Sparse Coding

We propose an algorithm for rotational sparse coding along with an effic...
research
04/16/2016

Efficient Dictionary Learning with Sparseness-Enforcing Projections

Learning dictionaries suitable for sparse coding instead of using engine...
research
08/31/2017

Online Convolutional Dictionary Learning

Convolutional sparse representations are a form of sparse representation...
research
04/16/2018

Learning Simple Thresholded Features with Sparse Support Recovery

The thresholded feature has recently emerged as an extremely efficient, ...

Please sign up or login with your details

Forgot password? Click here to reset