Information theory¶

Basic properties¶

  • likely events have low information content

  • less likely events have higher information content

  • independent events have additive information