An Importance Aware Weighted Coding Theorem Using Message Importance Measure

05/21/2020
by   Zheqi Zhu, et al.
0

There are numerous scenarios in source coding where not only the code length but the importance of each value should also be taken into account. Different from the traditional coding theorems, by adding the importance weights for the length of the codes, we define the average cost of the weighted codeword length as an importance-aware measure of the codes. This novel information theoretical measure generalizes the average codeword length by assigning importance weights for each symbol according to users' concerns through focusing on user's selections. With such definitions, coding theorems of the bounds are derived and the outcomes are shown to be extensions of traditional coding theorems.

READ FULL TEXT

page 1

page 2

page 5

research
09/12/2023

A Complete Proof of an Important Theorem for Variable-to-Variable Length Codes

Variable-to-variable length (VV) codes are a class of lossless source co...
research
08/10/2023

PAC Codes for Source and Joint Source-Channel Coding

Polarization-adjusted convolutional (PAC) codes, as a concatenated codin...
research
09/25/2019

Multiple-Rate Channel Codes in GF(p^n^2)

A code C(n, k, d) defined over GF(q^n) is conventionally designed to enc...
research
05/07/2022

Rate-Constrained Shaping Codes for Finite-State Channels With Cost

Shaping codes are used to generate code sequences in which the symbols o...
research
03/11/2020

Asymptotic Expansions of Smooth Rényi Entropies and Their Applications

This study considers the unconditional smooth Rényi entropy, the smooth ...
research
01/15/2019

A New Inequality Related to Proofs of Strong Converse Theorems in Multiterminal Information Theory

In this paper we provide a new inequality useful for the proofs of stron...
research
09/03/2018

Minimum Description Length codes are critical

Learning from the data, in Minimum Description Length (MDL), is equivale...

Please sign up or login with your details

Forgot password? Click here to reset