This script takes a site URL as an argument and creates a map of that domain as a Python dictionary.

Dictionaries contains URL, title and links within every site.

Script will work properly with exemplary site url: http://0.0.0.0:8000

• Clone this repository to your computer using link:

    https://github.com/Sonny-skyez/Web_Crawler

• Use package manager pip to install required Python packages:

    pip install requests
    pip install beautifulsoup4

To use this script you need to run Web_crawler.py with Python 3.7 interpreter.

• Pycharm - Python IDE for developers

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

Krzysztof Brymer - script author GitHub profile

MIT License