1, scrapy (python crawler) 2, pyspider (python crawler) 3. Crawler4j (java stand-alone crawler) 4. WebMagic (java stand-alone crawler) 5. WebCollecto (java stand-alone crawler) 6, Heritrix (java crawler) )
1, scrapy (python crawler) 2, pyspider (python crawler) 3. Crawler4j (java stand-alone crawler) 4. WebMagic (java stand-alone crawler) 5. WebCollecto (java stand-alone crawler) 6, Heritrix (java crawler) )