Romtveit, Tarjei (Master thesis, 2010)
Distributed Web-Crawlers, i.e. , Web-Crawler Networks, have been known to retrieve
massive amount of web-data to centralized search indexes the last decade. Companies
like Google, Yahoo and lately Integrasco, have built ...