Movie metadata scraper and organizer for media libraries and NFO
Open source file indexing & storage analytics powered by Elasticsearch
Download and manage Bilibili Manga chapters with GUI downloader
Python crawler to download photos and videos from Tumblr blogs
Lightweight Python tool for downloading videos from many platforms
Scrape job websites into a single spreadsheet with no duplicates.
Open source Douyin crawler for collecting and downloading public data
All-in-one Python web reconnaissance tool for fast target analysis
Python crawler and API for downloading JMComic albums and images
A tool to scrape images from SimpCity
Python & command-line tool to gather text on the Web
Python crawler for collecting and downloading Sina Weibo user data
Python tool for crawling and extracting structured data from news site
Kemono Downloader - A cross-platform Python app built with PyQt6
Command-line Bilibili video and danmaku downloader with batch support
Web crawler that finds hidden web directories without brute force
Distributed Crawler Management Framework Based on Scrapy
Descubre archivos, rutas escondidas realizando busquedas avanzadas
A service daemon to run Scrapy spiders
Web crawler for archiving and backing up sites into WARC archives
Simple Python framework for building multithreaded web crawlers
Instagram profile crawler that extracts posts, tags, and stats
Async Python framework for fast and flexible web scraping spiders
Collection of Python ecommerce and website crawler examples projects
DSTK - DataScience ToolKit for All of Us