Python HTTP client with TLS and HTTP/2 fingerprint emulation support
The complete web scraping toolkit for PHP
Collection of 100+ Python web scraping projects and crawler examples
Distributed Crawler Management Framework Based on Scrapy
A service daemon to run Scrapy spiders
Using industrial automation techniques for creating web scraping tools
Simple Python framework for building multithreaded web crawlers
Async Python framework for fast and flexible web scraping spiders
Collection of Python ecommerce and website crawler examples projects
Asynchronous tool for finding and checking public proxy servers