Movie metadata scraper and organizer for media libraries and NFO
Open source enterprise search server for websites, files, and data
Fast CLI tool for cloning entire websites for local browsing offline
Small event-delegation library for decoupling event binding and handli
Open source file indexing & storage analytics powered by Elasticsearch
Download and manage Bilibili Manga chapters with GUI downloader
Python crawler to download photos and videos from Tumblr blogs
Lightweight Python tool for downloading videos from many platforms
Lightweight cross-platform desktop client for managing Mihomo proxies
Open source Douyin crawler for collecting and downloading public data
Python crawler and API for downloading JMComic albums and images
Python crawler for collecting and downloading Sina Weibo user data
Python tool for crawling and extracting structured data from news site
Automate the download of entire Twitch.tv channels
Collection of 100+ Python web scraping projects and crawler examples
Command-line Bilibili video and danmaku downloader with batch support
Web crawler that finds hidden web directories without brute force
Easy Spider is a distributed Perl Web Crawler Project from 2006
Headless Chrome crawler for collecting URLs for vulnerability scans
Web crawler for archiving and backing up sites into WARC archives
Simple Python framework for building multithreaded web crawlers
Automated mobile app crawler and testing tool built on Appium
Instagram profile crawler that extracts posts, tags, and stats
Async Python framework for fast and flexible web scraping spiders
Guide and resources for accessing and using the U3C3 BitTorrent site