Entropy rate

The entropy rate (english entropy rate) allows in information theory, regardless of the length of a message is a measurement of the entropy with respect to a character.

Formally, they can be defined as follows:

Here, the number of characters of the message and the number of random variables.

The entropy allows a comparison of the entropies of messages of varying length.

• Information Theory