Open-source LLM Friendly Web Crawler & Scraper
All-in-one Python web reconnaissance tool for fast target analysis
An adaptive Web Scraping framework
Python HTTP client with TLS and HTTP/2 fingerprint emulation support
The best free open source website change detection and restock service
Web app for Scrapyd cluster management
Movie metadata scraper and organizer for media libraries and NFO
Multiprocess Selenium crawler for downloading images by keywords
Open source file indexing & storage analytics powered by Elasticsearch
Python tool for crawling and extracting structured data from news site
Vertical novel search engine with unified reading and tracking tools
Python crawler to download photos and videos from Tumblr blogs
Web crawler that finds hidden web directories without brute force
Distributed Crawler Management Framework Based on Scrapy
Python library providing APIs for automated website login workflows
Intelligent proxy pool for collecting and managing public proxies
Async Python framework for fast and flexible web scraping spiders
Python tool for scraping search engine results from many providers
Asynchronous tool for finding and checking public proxy servers
Python library to crawl and retrieve data from WeChat accounts
A powerful Spider(Web Crawler) system in Python
DSTK - DataScience ToolKit for All of Us
Massive SQL injection vulnerability scanner for automated web testing
Finds all the security information for a given domain name