Git Product home page Git Product logo

requeststatus's Introduction

RequestStatus

This repository contains the code for getting the status code of the website from a xml file. Basically the code iterates through the sitemap and hits all the urls present in the <loc> tag and returns the status code of the url. The data has been fed into an Excel file.

Run the code

python main.py

Files Needed

Sitemap.xml -- The files which contains the sitemap data

Total alerts

requeststatus's People

Contributors

senbagaraman04 avatar

Watchers

 avatar  avatar

requeststatus's Issues

Security bug BAN-B314

Using various XML methods to parse untrusted XML data is known to be vulnerable to XML attacks. Using the defusedxml module is recommended. Methods should be replaced with their defusedxml equivalents.

Access to a protected member _create_unverified_context of a client class PYL-W0212

Accessing a protected member (a member prefixed with _) of a class from outside that class is not recommended, since the creator of that class did not intend this member to be exposed. If accesing this attribute outside of the class is absolutely needed, refactor it such that it becomes part of the public interface of the class.

multiple imports on one line FLK-E401

writefile.py
Imports from different modules should be on different lines.

import os, sys # multiple imports on same line

instead these imports should be on their own line

import os
import sys

ValueError: More than 4094 XFs (styles)

In code, while trying to update the excel after around 4K th line, the following error occurred

raise ValueError("More than 4094 XFs (styles)")
ValueError: More than 4094 XFs (styles)

SSL Certificate issue

Even after using

try:
    _create_unverified_https_context = ssl._create_unverified_context
except AttributeError:
    # Legacy Python that doesn't verify HTTPS certificates by default
    pass
else:
    # Handle target environment that doesn't support HTTPS verification
    ssl._create_default_https_context = _create_unverified_https_context

#To ignore Http Errors/SSL Error
if (not os.environ.get('PYTHONHTTPSVERIFY', '') and
    getattr(ssl, '_create_unverified_context', None)): 
    ssl._create_default_https_context = ssl._create_unverified_context

SSL certificate error occurs

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.