Overcomplete order-3 tensor decomposition, blind deconvolution and Gaussian mixture models

07/16/2020
by   Haolin Chen, et al.
0

We expand the family of tensors that can be efficiently decomposed and apply our new algorithmic ideas to blind deconvolution and Gaussian mixture models. Our basic contribution is an efficient algorithm to decompose certain symmetric overcomplete order-3 tensors, that is, three dimensional arrays of the form T = ∑_i=1^n a_i ⊗ a_i ⊗ a_i where the a_is are not linearly independent. Our second contribution builds on top of our tensor decomposition algorithm to expand the family of Gaussian mixture models whose parameters can be estimated efficiently. These ideas are also presented in a much more general framework of blind deconvolution that makes them applicable to mixture models of identical but very general distributions, including all centrally symmetric distributions with finite 6th moment.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2021

Learning Diagonal Gaussian Mixture Models and Incomplete Tensor Decompositions

This paper studies how to learn parameters in diagonal Gaussian mixture ...
research
06/01/2021

Tensor decomposition for learning Gaussian mixtures from moments

In data processing and machine learning, an important challenge is to re...
research
02/14/2022

Tensor Moments of Gaussian Mixture Models: Theory and Applications

Gaussian mixture models (GMM) are fundamental tools in statistical and d...
research
04/11/2019

Direct Fitting of Gaussian Mixture Models

When fitting Gaussian Mixture Models to 3D geometry, the model is typica...
research
07/28/2019

Towards Understanding and Modeling Empathy for Use in Motivational Design Thinking

Design Thinking workshops are used by companies to help generate new ide...
research
10/25/2022

Moment Estimation for Nonparametric Mixture Models Through Implicit Tensor Decomposition

We present an alternating least squares type numerical optimization sche...
research
06/01/2018

Radio Galaxy Morphology Generation Using DNN Autoencoder and Gaussian Mixture Models

The morphology of a radio galaxy is highly affected by its central activ...

Please sign up or login with your details

Forgot password? Click here to reset