khilnani / spidey.py Goto Github PK
View Code? Open in Web Editor NEWWeb spiders are usually disliked by websites, but useful for recursive API/page downloads for offline analysis.
Home Page: https://pypi.python.org/pypi/spidey.py
License: MIT License