Download
Dude is a very simple framework for writing web scrapers using Python decorators. The design, inspired by Flask, was to easily build a web scraper in just a few lines of code. Dude has an easy-to-learn syntax. Dude is currently in Pre-Alpha. Please expect breaking changes. You can run your scraper from terminal/shell/command-line by supplying URLs, the output filename of your choice and the paths to your python scripts to dude scrape command.
Features
- Minimal web scraper
- The output in data.json should contain the actual URL and the metadata prepended with underscore
- Simple Flask-inspired design - build a scraper with decorators
- Uses Playwright API - run your scraper in Chrome, Firefox and Webkit and leverage Playwright's powerful selector engine supporting CSS, XPath, text, regex, etc.
- Data grouping - group related results
- URL pattern matching - run functions on matched URLs
- Setup function - enable setup steps (clicking dialogs or login)
Project Samples
Categories
Web ScrapersLicense
Affero GNU Public LicenseFollow dude uncomplicated data extraction
Other Useful Business Software
Failed Payment Recovery for Subscription Businesses
FlexPay’s innovative platform uses multiple technologies to achieve the highest number of retained customers, resulting in reduced involuntary churn, longer life span after recovery, and higher revenue. Leading brands like LegalZoom, Hooked on Phonics, and ClinicSense trust FlexPay to recover failed payments, reduce churn, and increase customer lifetime value.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of dude uncomplicated data extraction!
