Web Crawler - OSSRank

Rank	Project
916 137	Scrapy Web Crawler Web Scraper Zyte started in 2008 12,666 commits 731 contributors
1709 230	StormCrawler Web Crawler started in 2013 2,100 commits 66 contributors
1918 59	Heritrix Web Crawler started in 2009 2,745 commits 64 contributors
2251 71	Katana Web Crawler started in 2022 379 commits 50 contributors
2756 209	EasySpider Web Crawler Web Scraper started in 1970 611 commits 11 contributors
2815 8	WebMagic Web Crawler started in 2013 1,287 commits 69 contributors
2871 105	Apache Nutch Web Crawler started in 2005 3,499 commits 89 contributors
2892 235	Apache ManifoldCF Web Crawler started in 2010 5,230 commits 26 contributors
3415 25	Photon Web Crawler started in 2018 328 commits 20 contributors
3673 10	pyspider Python Library Web Crawler started in 2014 1,181 commits 62 contributors