Open source Douyin crawler for collecting and downloading public data
Async Python library in automating Chromium browsers without WebDriver
A lightweight approach to removing Google web service dependency
Python & command-line tool to gather text on the Web
Web Scraping Framework
Open-source LLM Friendly Web Crawler & Scraper
Comprehensive search engine for books, papers, comics, magazines
Scrape tweets, profiles, followers and following from Twitter/X
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
This is a public repository containing scrapers
Python binding to Modest and Lexbor engines
Python client for FCM - Firebase Cloud Messaging
Easily turn large sets of image urls to an image dataset
Collection of JS reverse engineering examples for web scraping study
PostHog provides open-source web & product analytics
Download and manage Bilibili Manga chapters with GUI downloader
Movie metadata scraper and organizer for media libraries and NFO
Develop and test your cloud apps offline
Python library for scraping and analyzing online news articles easily
An adaptive Web Scraping framework
Python crawler to download photos and videos from Tumblr blogs
openvpn-monitor is a web based OpenVPN monitor
NBA Stats API via Basketball Reference
A framework for browser automation and testing with Selenium
Redis-based components for Scrapy