olemus
liik juhuslikke protsesse, milles järgmise oleku tõenäosus
sõltub ainult hetkeolekust ja
ei sõltu eelnenud olekumuutuste jadast

Wiktionary:
(probability theory) any stochastic process for which the conditional probability distribution of future states depends only on the current state (and not on past states)

ülevaateid
http://setosa.io/ev/markov-chains/

https://en.wikipedia.org/wiki/Markov_chain

https://en.wikipedia.org/wiki/Examples_of_Markov_chains

https://www.stat.auckland.ac.nz/~fewster/325/notes/ch8.pdf

http://web.math.ku.dk/noter/filer/stoknoter.pdf

rakendusi
http://www.math.chalmers.se/Stat/Grundutb/CTH/mve220/1617/redingprojects16-17/IntroMarkovChainsandApplications.pdf

http://langvillea.people.cofc.edu/MCapps7.pdf

https://telsoc.org/journal/jtde-v7-n1/a181

https://arxiv.org/pdf/1501.01901.pdf

https://onlinelibrary.wiley.com/doi/full/10.1002/eng2.12065

https://research.csiro.au/isp/wp-content/uploads/sites/106/2016/08/lcn_finalVersion.pdf

http://probability.ca/jeff/ftpdir/decipherart.pdf

vt ka
- Markovi otsustusprotsess
- Markovi peitmudel