Slybot is a Python web crawler for doing web scraping. It's implemented on top of the Scrapy web crawling framework and the Scrapely extraction library.

The documentation (including installation and usage) can be found at: http://slybot.readthedocs.org/