A scalable web crawler framework for Java
Library for extracting streaming site data without official APIs
Free batch downloader for image, wallpaper, video, audio, document,
Distributed web crawler admin platform for spiders management
Automated mobile app crawler and testing tool built on Appium
Lightweight Java web crawler framework with jQuery-style extraction
WebCollector is an open source web crawler framework based on Java.