An Entropy Power Inequality for Discrete Random Variables
share
Let N_ d[X]=1/2π e e^2H[X] denote the entropy power of the discrete random variable X where H[X] denotes the discrete entropy of X. In this paper, we show that for two independent discrete random variables X and Y, the entropy power inequality N_ d[X]+N_ d[Y]≤ 2 N_ d[X+Y] holds and it can be tight. The basic idea behind the proof is to perturb the discrete random variables using suitably designed continuous random variables. Then, the continuous entropy power inequality is applied to the sum of the perturbed random variables and the resulting lower bound is optimized.
READ FULL TEXT