sajad22 / domaincrawler Goto Github PK
View Code? Open in Web Editor NEWThis project forked from p4u/domaincrawler
It is an HTTP crawler which looks for domains in <a> tags and sotres them into a sqlite database next to their IP address. it works recursively among the stored domains.
License: GNU General Public License v2.0