Statistics on the (compact) Stiefel manifold: Theory and Applications

by   Rudrasis Chakraborty, et al.

A Stiefel manifold of the compact type is often encountered in many fields of Engineering including, signal and image processing, machine learning, numerical optimization and others. The Stiefel manifold is a Riemannian homogeneous space but not a symmetric space. In previous work, researchers have defined probability distributions on symmetric spaces and performed statistical analysis of data residing in these spaces. In this paper, we present original work involving definition of Gaussian distributions on a homogeneous space and show that the maximum-likelihood estimate of the location parameter of a Gaussian distribution on the homogeneous space yields the Fréchet mean (FM) of the samples drawn from this distribution. Further, we present an algorithm to sample from the Gaussian distribution on the Stiefel manifold and recursively compute the FM of these samples. We also prove the weak consistency of this recursive FM estimator. Several synthetic and real data experiments are then presented, demonstrating the superior computational performance of this estimator over the gradient descent based non-recursive counter part as well as the stochastic gradient descent based method prevalent in literature.


page 1

page 2

page 3

page 4


Solution manifold and Its Statistical Applications

A solution manifold is the collection of points in a d-dimensional space...

Escape saddle points faster on manifolds via perturbed Riemannian stochastic recursive gradient

In this paper, we propose a variant of Riemannian stochastic recursive g...

On the Convergence of Gradient Descent in GANs: MMD GAN As a Gradient Flow

We consider the maximum mean discrepancy (MMD) GAN problem and propose a...

Low-complexity subspace-descent over symmetric positive definite manifold

This work puts forth low-complexity Riemannian subspace descent algorith...

Dynamic Flows on Curved Space Generated by Labeled Data

The scarcity of labeled data is a long-standing challenge for many machi...

Strong Local Nondeterminism and Exact Modulus of Continuity for Isotropic Gaussian Random Fields on Compact Two-Point Homogeneous Spaces

This paper is concerned with sample path properties of isotropic Gaussia...

Stochastic Neighbor Embedding with Gaussian and Student-t Distributions: Tutorial and Survey

Stochastic Neighbor Embedding (SNE) is a manifold learning and dimension...

Please sign up or login with your details

Forgot password? Click here to reset