olemus
sõnestuse pöördoperatsioon
=
the reverse operation of tokenization, which is where an input character sequence is split into pieces called tokens

näiteid
https://tech.webinterpret.com/how-to-build-a-machine-learning-based-detokenizer-part-ii-decoding/

https://peteris.rocks/blog/detokenization-in-machine-translation/

http://www.iro.umontreal.ca/~felipe/TALN2010/Xml/Papers/taln/taln2010_submission_91.pdf

vt ka
- parsimine