The Matrix Hilbert Space and Its Application to Matrix Learning

06/25/2017
by   Yunfei Ye, et al.
0

Theoretical studies have proven that the Hilbert space has remarkable performance in many fields of applications. Frames in tensor product of Hilbert spaces were introduced to generalize the inner product to high-order tensors. However, these techniques require tensor decomposition which could lead to the loss of information and it is a NP-hard problem to determine the rank of tensors. Here, we present a new framework, namely matrix Hilbert space to perform a matrix inner product space when data observations are represented as matrices. We preserve the structure of initial data and multi-way correlation among them is captured in the process. In addition, we extend the reproducing kernel Hilbert space (RKHS) to reproducing kernel matrix Hilbert space (RKMHS) and propose an equivalent condition of the space uses of the certain kernel function. A new family of kernels is introduced in our framework to apply the classifier of Support Tensor Machine(STM) and comparative experiments are performed on a number of real-world datasets to support our contributions.

READ FULL TEXT
research
02/08/2020

Reproducing Kernel Hilbert Spaces Cannot Contain all Continuous Functions on a Compact Metric Space

Given an uncountable, compact metric space, we show that there exists no...
research
07/20/2017

A Nonlinear Kernel Support Matrix Machine for Matrix Learning

Tensor is a natural and compact representation for real world data which...
research
10/12/2021

Countable Tensor Products of Hermite Spaces and Spaces of Gaussian Kernels

In recent years finite tensor products of reproducing kernel Hilbert spa...
research
01/07/2016

Learning Kernels for Structured Prediction using Polynomial Kernel Transformations

Learning the kernel functions used in kernel methods has been a vastly e...
research
08/05/2014

Adaptive Learning in Cartesian Product of Reproducing Kernel Hilbert Spaces

We propose a novel adaptive learning algorithm based on iterative orthog...
research
04/07/2023

Representer Theorems for Metric and Preference Learning: A Geometric Perspective

We explore the metric and preference learning problem in Hilbert spaces....
research
09/26/2018

Generalization Properties of hyper-RKHS and its Application to Out-of-Sample Extensions

Hyper-kernels endowed by hyper-Reproducing Kernel Hilbert Space (hyper-R...

Please sign up or login with your details

Forgot password? Click here to reset