A framework for browser automation and testing with Selenium
Python crawler to download photos and videos from Tumblr blogs
All-in-one Python web reconnaissance tool for fast target analysis
Python crawler for collecting and downloading Sina Weibo user data
Python tool for crawling and extracting structured data from news site
Tiny status page generated by a Python script
Frouros is an open-source Python library for drift detection
Easily turn large sets of image urls to an image dataset
Cross platform GUI tool for downloading videos from Bilibili sites
Python HTTP library with thread-safe connection pooling
Redis-based components for Scrapy
This is the most powerful software taking into account CIS location
Bringing Http/Https and WebSockets High Performance servers for PyPy3
NBA Stats API via Basketball Reference
Open source Douyin crawler for collecting and downloading public data
jsii allows code in any language to naturally interact with JavaScript
Scrape tweets, profiles, followers and following from Twitter/X
Utilize all available CPU cores for accepting new client connections
Download and manage Bilibili Manga chapters with GUI downloader
Python library for scraping and analyzing online news articles easily
Persistent HTTP cache for python requests
Check links in web documents or full websites
A next generation HTTP client for Python
PostHog provides open-source web & product analytics
Open-source LLM Friendly Web Crawler & Scraper