Dyadic distribution

From HandWiki

A dyadic (or 2-adic) distribution is a specific type of discrete probability distribution that is of some theoretical importance in data compression.

Definition

A dyadic distribution is a probability distribution whose probability mass function is

[math]\displaystyle{ f(i) = 2^{-x_i} }[/math]

where [math]\displaystyle{ x_i }[/math] is some whole number.

It is possible to find a binary code defined on this distribution, which has an average code length that is equal to the entropy.[1]

References

  1. Cover, T.M., Joy A. Thomas, J.A. (2006) Elements of information theory, Wiley. ISBN:0-471-24195-4
  • Cover, T.M., Joy A. Thomas, J.A. (2006) Elements of information theory, Wiley. ISBN:0-471-24195-4