A Python library for automating interaction with websites
This is a public repository containing scrapers
Python crawler to download photos and videos from Tumblr blogs
NBA Stats API via Basketball Reference
Scrape tweets, profiles, followers and following from Twitter/X
Realtime crawler for COVID-19 outbreak statistics from DXY data
Python library for scraping and analyzing online news articles easily
Python crawler for collecting and downloading Sina Weibo user data
Collection of JS reverse engineering examples for web scraping study
Distributed Crawler Management Framework Based on Scrapy
A service daemon to run Scrapy spiders
Using industrial automation techniques for creating web scraping tools
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
ML-based HTML scraper that learns extraction rules from examples
JavaScript + BeautifulSoup = JSSoup
Python bindings for the Chromium Embedded Framework (CEF)
Python tool for scraping search engine results from many providers
Collection of Python ecommerce and website crawler examples projects
Creating Scrapy scrapers via the Django admin interface
Python crawler that downloads image galleries and analyzes titles
Twitter Intelligence OSINT project performs tracking and analysis
A powerful Spider(Web Crawler) system in Python
Convert websites into structured APIs automatically with Python tool
Massive SQL injection vulnerability scanner for automated web testing