olemus
IEC 732:
otsimootori osa, mis kogub andmeid netiressursside kohta
ja talletab neid andmebaasis
= the component of a search engine that collects data from Internet resources and stores them in a database

näiteid
https://en.wikipedia.org/wiki/Web_crawler

https://www.searchenginepeople.com/blog/search-robots-the-good-the-bad-and-the-googlebot.html

https://www.incapsula.com/blog/most-active-good-bots.html

vt ka
- ämblik