olemus
informatsiooni entroopiapõhise mõõtmise distsipliin,
mille rajas C. E. Shannon 1948. a.

ISO/IEC 2382:
teadusharu, mis tegeleb
informatsiooni kvantitatiivsete mõõtudega
=
branch of learning concerned with
quantitative measures of information

rakendusi
- andmete tihendamine
- kanalikodeerimine
- keerukusteooria
- kujutuvastus
- kvantarvutused
- krüptograafia
- lingvistika
- statistikamudelid
- turvatõestused jt

ülevaateid
https://en.wikipedia.org/wiki/History_of_information_theory

https://en.wikipedia.org/wiki/Information_theory

http://www.cs.cmu.edu/~roni/10601-slides/info-theory.pdf

http://alex.smola.org/teaching/cmu2013-10-701x/slides/R8-information_theory.pdf

https://inst.eecs.berkeley.edu/~ee126/fa20/notes/info_theory.pdf

http://belohlavek.inf.upol.cz/vyuka/InformationTheoryAndApplications.pdf

https://web.stanford.edu/~montanar/RESEARCH/BOOK/partA.pdf

https://web.mit.edu/6.933/www/Fall2001/Shannon2.pdf

Shannoni artikkel
https://en.wikipedia.org/wiki/A_Mathematical_Theory_of_Communication

http://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf

vt ka
- Shannoni entroopia