ℓ_1-K-SVD: A Robust Dictionary Learning Algorithm With Simultaneous Update

by   Subhadip Mukherjee, et al.

We develop a dictionary learning algorithm by minimizing the ℓ_1 distortion metric on the data term, which is known to be robust for non-Gaussian noise contamination. The proposed algorithm exploits the idea of iterative minimization of weighted ℓ_2 error. We refer to this algorithm as ℓ_1-K-SVD, where the dictionary atoms and the corresponding sparse coefficients are simultaneously updated to minimize the ℓ_1 objective, resulting in noise-robustness. We demonstrate through experiments that the ℓ_1-K-SVD algorithm results in higher atom recovery rate compared with the K-SVD and the robust dictionary learning (RDL) algorithm proposed by Lu et al., both in Gaussian and non-Gaussian noise conditions. We also show that, for fixed values of sparsity, number of dictionary atoms, and data-dimension, the ℓ_1-K-SVD algorithm outperforms the K-SVD and RDL algorithms when the training set available is small. We apply the proposed algorithm for denoising natural images corrupted by additive Gaussian and Laplacian noise. The images denoised using ℓ_1-K-SVD are observed to have slightly higher peak signal-to-noise ratio (PSNR) over K-SVD for Laplacian noise, but the improvement in structural similarity index (SSIM) is significant (approximately 0.1) for lower values of input PSNR, indicating the efficacy of the ℓ_1 metric.


Denoising and Completion of 3D Data via Multidimensional Dictionary Learning

In this paper a new dictionary learning algorithm for multidimensional d...

Cloud K-SVD for Image Denoising

Cloud K-SVD is a dictionary learning algorithm that can train at multipl...

Computational Intractability of Dictionary Learning for Sparse Representation

In this paper we consider the dictionary learning problem for sparse rep...

Denoising Dictionary Learning Against Adversarial Perturbations

We propose denoising dictionary learning (DDL), a simple yet effective t...

Cloud K-SVD: A Collaborative Dictionary Learning Algorithm for Big, Distributed Data

This paper studies the problem of data-adaptive representations for big,...

Optimization of Clustering for Clustering-based Image Denoising

In this paper, the problem of de-noising of an image contaminated with a...

Identification of refugee influx patterns in Greece via model-theoretic analysis of daily arrivals

The refugee crisis is perhaps the single most challenging problem for Eu...

Please sign up or login with your details

Forgot password? Click here to reset