olemus
suurus, mis iseloomustab juhusliku suuruse \(X\) infosisaldust:
\(H(X) = p_1 \log_2 \frac{1}{p_1} + p_2 \log_2 \frac{1}{p_2} + \ldots \) ,
kus \(p_1, p_2, \ldots \) on suuruse \(X\) võimalike väärtuste tõenäosused
= the quantity that characterizes the information content of a random variable

ülevaateid
https://en.wikipedia.org/wiki/Entropy_(information_theory)

https://arxiv.org/pdf/1405.2061.pdf

http://www.ueltschi.org/teaching/chapShannon.pdf

http://www.bourbaphy.fr/rioul.pdf

https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf

https://ee.stanford.edu/~gray/it.pdf

https://eprint.iacr.org/2014/967.pdf

http://theory.caltech.edu/~preskill/ph219/chap10_6A.pdf

vt ka
- entroopia
- Rényi entroopia
- infoteooria