The condition number of many tensor decompositions is invariant under Tucker compression

06/24/2021
by   Nick Dewaele, et al.
0

We characterise the sensitivity of several additive tensor decompositions with respect to perturbations of the original tensor. These decompositions include canonical polyadic decompositions, block term decompositions, and sums of tree tensor networks. Our main result shows that the condition number of all these decompositions is invariant under Tucker compression. This result can dramatically speed up the computation of the condition number in practical applications. We give the example of an 265× 371× 7 tensor of rank 3 from a food science application whose condition number was computed in 6.9 milliseconds by exploiting our new theorem, representing a speedup of four orders of magnitude over the previous state of the art.

READ FULL TEXT
research
10/08/2021

Three decompositions of symmetric tensors have similar condition numbers

We relate the condition numbers of computing three decompositions of sym...
research
05/19/2023

What part of a numerical problem is ill-conditioned?

Many numerical problems with input x and output y can be formulated as a...
research
06/13/2012

Bounding Search Space Size via (Hyper)tree Decompositions

This paper develops a measure for bounding the performance of AND/OR sea...
research
06/18/2020

Tensor Decompositions in Recursive NeuralNetworks for Tree-Structured Data

The paper introduces two new aggregation functions to encode structural ...
research
02/26/2020

Tensor Decompositions in Deep Learning

The paper surveys the topic of tensor decompositions in modern machine l...
research
05/09/2023

How Informative is the Approximation Error from Tensor Decomposition for Neural Network Compression?

Tensor decompositions have been successfully applied to compress neural ...
research
10/09/2020

Concurrent Alternating Least Squares for multiple simultaneous Canonical Polyadic Decompositions

Tensor decompositions, such as CANDECOMP/PARAFAC (CP), are widely used i...

Please sign up or login with your details

Forgot password? Click here to reset