olemus
ämbliku automaatprotsess skaneerivaks veebilehtede poole pöördumiseks nende indekseerimise eesmärgil
= the process of indexing data on web pages by using a program or automated script

ülevaateid
https://www.octoparse.com/blog/web-crawling-vs-web-scraping
https://www.ics.uci.edu/~lopes/teaching/cs221W15/slides/WebCrawling.pdf
https://www.cis.uni-muenchen.de/~yeong/Kurse/ss09/WebDataMining/kap8_rev.pdf
https://uk.sagepub.com/sites/default/files/upm-assets/87152_book_item_87152.pdf
https://nlp.stanford.edu/IR-book/pdf/20crawl.pdf
http://infolab.stanford.edu/~olston/publications/crawling_survey.pdf
http://www.dia.uniroma3.it/~vldbproc/017_129.pdf
https://aircconline.com/avc/V3N3/3316avc01.pdf
https://idus.us.es/bitstream/handle/11441/105031/Deep%20Web%20crawling%20%20a%20survey.pdf;jsessionid=C1F8F934C0C71C5D41836412CF7EE3C2?sequence=1

vt ka
- ämblik