A small, ready-to-run Python web scraper toolkit that includes a CLI, a polite HTTP client, site adapters for demo scraping websites, and an optional Flask web interface.
- Command-line scraper (
cli.py) with:--site(quotes,books)--pages--tag(for quotes only)--out(supports.csvor.xlsx)
- Polite
HttpClient(delay + rotating user-agents) - CSV/Excel export using pandas
- Optional Flask UI for easy scraping
- Unit tests using pytest
- MIT licensed and educationally safe
python -m venv .venv
.venv\Scripts\activate # Windows
pip install -r requirements.txt