On a generalization of the Jensen-Shannon divergence

12/02/2019
by   Frank Nielsen, et al.
0

The Jensen-Shannon divergence is a renown bounded symmetrization of the Kullback-Leibler divergence which does not require probability densities to have coinciding support. In this paper, we introduce a vector-skew generalization of the α-Jensen-Bregman divergences and derive thereof the vector-skew α-Jensen-Shannon divergences. We study the properties of these novel divergences and show how to build parametric families of symmetric Jensen-Shannon-type divergences. Finally, we report an algorithm to compute these Jensen-Shannon-type centroids for a set of probability densities belonging to a mixture family.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/21/2010

A family of statistical symmetric divergences based on Jensen's inequality

We introduce a novel parametric family of symmetric information-theoreti...
research
12/05/2018

A Short Note on the Jensen-Shannon Divergence between Simple Mixture Distributions

This short note presents results about the symmetric Jensen-Shannon dive...
research
10/28/2008

A non-negative expansion for small Jensen-Shannon Divergences

In this report, we derive a non-negative series expansion for the Jensen...
research
10/24/2022

Online Critical-State Detection of Sepsis Among ICU Patients using Jensen-Shannon Divergence

Sepsis is a severe medical condition caused by a dysregulated host respo...
research
02/19/2021

On a Variational Definition for the Jensen-Shannon Symmetrization of Distances based on the Information Radius

We generalize the Jensen-Shannon divergence by considering a variational...
research
11/06/2019

Metrics Induced by Quantum Jensen-Shannon-Renyí and Related Divergences

We study symmetric divergences on Hermitian positive definite matrices g...
research
03/17/2022

Advances in Shannon-Based Communications and Computations Approaches to Understanding Information Processing in the Brain

This article serves as a supplement to the recently published call for p...

Please sign up or login with your details

Forgot password? Click here to reset