A Split-and-Merge Dictionary Learning Algorithm for Sparse Representation

by   Subhadip Mukherjee, et al.

In big data image/video analytics, we encounter the problem of learning an overcomplete dictionary for sparse representation from a large training dataset, which can not be processed at once because of storage and computational constraints. To tackle the problem of dictionary learning in such scenarios, we propose an algorithm for parallel dictionary learning. The fundamental idea behind the algorithm is to learn a sparse representation in two phases. In the first phase, the whole training dataset is partitioned into small non-overlapping subsets, and a dictionary is trained independently on each small database. In the second phase, the dictionaries are merged to form a global dictionary. We show that the proposed algorithm is efficient in its usage of memory and computational complexity, and performs on par with the standard learning strategy operating on the entire data at a time. As an application, we consider the problem of image denoising. We present a comparative analysis of our algorithm with the standard learning techniques, that use the entire database at a time, in terms of training and denoising performance. We observe that the split-and-merge algorithm results in a remarkable reduction of training time, without significantly affecting the denoising performance.


Computational Intractability of Dictionary Learning for Sparse Representation

In this paper we consider the dictionary learning problem for sparse rep...

Denoising and Completion of 3D Data via Multidimensional Dictionary Learning

In this paper a new dictionary learning algorithm for multidimensional d...

Efficient GPU Implementation for Single Block Orthogonal Dictionary Learning

Dictionary training for sparse representations involves dealing with lar...

A Study on Unsupervised Dictionary Learning and Feature Encoding for Action Classification

Many efforts have been devoted to develop alternative methods to traditi...

Efficient Dictionary Learning with Sparseness-Enforcing Projections

Learning dictionaries suitable for sparse coding instead of using engine...

Decentralized Complete Dictionary Learning via ℓ^4-Norm Maximization

With the rapid development of information technologies, centralized data...

Cloud K-SVD for Image Denoising

Cloud K-SVD is a dictionary learning algorithm that can train at multipl...

Please sign up or login with your details

Forgot password? Click here to reset