This is a Python script that scrapes a website for metadata and generates an XML file with the collected data. The script uses the requests and beautifulsoup4 libraries to retrieve and parse the HTML of the website, and the xml.etree.ElementTree and xml.dom.minidom libraries to create the XML file.

• Python 3.x
• requests library
• beautifulsoup4 library

Install this tool with pip

pip install requests
pip install beautifulsoup4

Clone the project

  git clone https://github.com/therealroomio/PySEO-Scraper

Go to the project directory

  cd PySEO-Scraper

Install dependencies

  pip install requests
  pip install beautifulsoup4

To use the script, open scrape.py and update the following line of code:

url = "https://google.com/"

Replace https://google.com/ with the URL of the website you want to scrape then run it in Python.

python3 scrape.py

The script will output an XML file in the same directory as the script, with the name <title>.xml. The file will contain the following metadata:

• Title
• Description
• Keywords
• Canonical URL
• Robots
• Open Graph title
• Open Graph description
• Open Graph image
• H1 tags
• H2 tags
• Image alt text

If any of the metadata is missing on the website, the script will insert "missing" as the value for that metadata.

@therealroomio using ChatGPT