Git Product home page Git Product logo

ticapsoriginal_website_score_overview's Introduction

Ticapsoriginal website score overview

Ticapsoriginal website sitemaps checker score overview based on sitemaps

scan large sitemaps

plotting chart with 10 domain metrics :

  • crawling and show total of linkbuttons to hrefs
  • crawling and show total of images
  • crawling and show total of divs
  • crawling and show total of sections
  • crawling and show total of metatags
  • crawling and show total of links
  • crawling and show total of paragraphs
  • crawling and show total of buttons
  • crawling and show total of scripts
  • crawling and show total of h2 subtitles

make python environment:

  • Install pip first:
sudo apt-get install python3-pip
  • Then install virtualenv using pip3
sudo pip3 install virtualenv 
  • Now create a virtual environment
virtualenv venv
  • Active your virtual environment:
source venv/bin/activate
  • Enter on environment:
cd venv

Install tkinter lib to see gui:

 sudo apt-get install python3-tk

Install tqdm to see progress bar:

pip install tqdm

Install requests to get responses and make requests:

pip install requests

Install matplotlib to plotting categorical chart:

pip install matplotlib

Install urllib parsing url data:

pip install urllib3

Install bs4 to access BeautilSoup library:

pip install bs4

Clone Ticapsoriginal_website_score_overview repository:

 git clone https://github.com/Tinoco/Ticapsoriginal_website_score_overview.git
  • Change the website_sitemap_overview.py file with your sitemap url

run Ticapsoriginal website overview:

 python website_sitemap_overview.py

Result ( domain large sitemap 10 metrics ):

to see full aplication unit test:

 python tests.py

to make behave test parse time of sitemaps Install behave and run behave :

 pip install behave
 behave

quality:

about:

ticapsoriginal_website_score_overview's People

Contributors

tinoco avatar

Stargazers

 avatar  avatar

Watchers

 avatar

Forkers

wanghaisheng

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.