Progressive PHP web crawler framework with jQuery-like DOM parsing
Open source web scraping system for automated data collection tasks
Open source file indexing & storage analytics powered by Elasticsearch
Open source enterprise search server for websites, files, and data
Automated mobile app crawler and testing tool built on Appium
Educational Python web scraping case collection for many sites
All-in-one reconnaissance and vulnerability scanning toolkit for sites
Lightweight Java web crawler framework with jQuery-style extraction
Open source Search Engine and Enterprise Search