Web Crawler - OSSRank

Rank	Project
1152 317	Scrapy Web Crawler Web Scraper Zyte started in 2008 12,575 commits 726 contributors
1745 112	StormCrawler Web Crawler started in 2013 2,084 commits 65 contributors
1957 721	Katana Web Crawler started in 2022 359 commits 48 contributors
2350 100	Heritrix Web Crawler started in 2009 2,642 commits 63 contributors
2419 82	EasySpider Web Crawler Web Scraper started in 1970 607 commits 11 contributors
2565 117	Apache Nutch Web Crawler started in 2005 3,498 commits 89 contributors
2568 87	WebMagic Web Crawler started in 2013 1,287 commits 69 contributors
3022 100	Apache ManifoldCF Web Crawler started in 2010 5,227 commits 26 contributors
3152 510	Photon Web Crawler started in 2018 328 commits 20 contributors
3682 6	pyspider Python Library Web Crawler started in 2014 1,181 commits 62 contributors