Accelerating Block Coordinate Descent for Nonnegative Tensor Factorization

01/13/2020
by   Andersen Man Shun Ang, et al.
0

This paper is concerned with improving the empirical convergence speed of block-coordinate descent algorithms for approximate nonnegative tensor factorization (NTF). We propose an extrapolation strategy in-between block updates, referred to as heuristic extrapolation with restarts (HER). HER significantly accelerates the empirical convergence speed of most existing block-coordinate algorithms for dense NTF, in particular for challenging computational scenarios, while requiring a negligible additional computational budget.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/27/2018

Sparse Nonnegative CANDECOMP/PARAFAC Decomposition in Block Coordinate Descent Framework: A Comparison Study

Nonnegative CANDECOMP/PARAFAC (NCP) decomposition is an important tool t...
research
02/25/2018

DID: Distributed Incremental Block Coordinate Descent for Nonnegative Matrix Factorization

Nonnegative matrix factorization (NMF) has attracted much attention in t...
research
06/15/2020

Nonconvex Optimization Tools for Large-Scale Matrix and Tensor Decomposition with Structured Factors

The proposed article aims at offering a comprehensive tutorial for the c...
research
03/07/2020

Efficient Nonnegative Tensor Factorization via Saturating Coordinate Descent

With the advancements in computing technology and web-based applications...
research
11/20/2017

Block-Cyclic Stochastic Coordinate Descent for Deep Neural Networks

We present a stochastic first-order optimization algorithm, named BCSC, ...
research
09/28/2020

Gradient based block coordinate descent algorithms for joint approximate diagonalization of matrices

In this paper, we propose a gradient based block coordinate descent (BCD...
research
05/30/2016

Minding the Gaps for Block Frank-Wolfe Optimization of Structured SVMs

In this paper, we propose several improvements on the block-coordinate F...

Please sign up or login with your details

Forgot password? Click here to reset