Git Product home page Git Product logo

proxxy's Introduction

proXXy typing out

proXXy is a powerful tool designed for acquiring and managing a vast quantity of proxies. It is used to gather, organize, and procure HTTP/S, SOCKS4, and SOCKS5 proxies. They can be used for web scraping, penetration testing, bypassing censorship, and many other tasks!

The software is currently capable of retrieving over 500,000 proxies from many different sources.

This project is for educational purposes only— Please do not use this for illegal activities.


Installation

  • Clone the repository:
git clone https://github.com/Atropa-Solanaceae/proXXy.git
  • Navigate to the project directory:
cd proXXy
  • Install the required dependencies:
pip3 install -r requirements.txt

Usage

  • Running the program without flags results in only scraping, as checking is disabled by default.
python3 proXXy.py

The program will output four files in the project directory containing the regularized proxy lists:

  • HTTP.txt
  • HTTPS.txt
  • SOCKS4.txt
  • SOCKS5.txt

along with an error output file titled error.log denoting the sources that were unable to be accessed.

Flags

The basic syntax for running proXXy is as follows:

usage: proXXy.py [-h] [--validate] [--update] [--version]
  1. -v, --validate: Use this flag to enable proxy validation. The scraper will attempt to validate the scraped proxies by checking their accessibility. Allow the program to complete the checking of HTTP & HTTPS proxies, then check the updated text files located in output/ directory! (Please allow for up to 10 minutes for proxies to validate, depending on your hardware.)

  2. -u, --update: This flag updates the project. Cannot be used in conjunction with any other flag.

  3. -h, --help: Use this flag to spit out a help menu.

  4. -V, --version: Use this flag to spit out proXXy.py's version.

usage: proXXy.py [-h] [--validate] [--update] [--version]

A super simple asynchronous multithreaded proxy scraper;
scraping & checking ~500k HTTP, HTTPS, SOCKS4, & SOCKS5 proxies.

options:
  -h, --help      show this help message and exit
  --validate, -v  Flag to validate proxies after scraping (default: False)
  --update, -u    Flag to run the update script and then exit
  --version, -V   Print the version of the script and exit

Planned Features

  • Fix Linux compatibility errors. proXXy currently does not support Linux verification, solely Windows-based systems.
  • Allow the user to choose the number of threads they'd like to use with flags, & provide the user recommended values based on their hardware.
  • Implement SOCKS4 & SOCKS5 testing.
  • Proxy sorting instead of hardcoding.
  • Discerning between Elite, Anonymous, and Transparent anonymity classes of proxies.

Support

Need help and can't get it to run correctly? Open an issue or contact me here.

Sponsorship

If you like what I do, buy me a coffee so I can continue developing this tool and others! Ko-Fi

Changelog

Release v2.4

  • Added a --version, -V flag
  • Segmented resources into separate files
  • Further modularized code, more to come shortly
  • Fixed build issues
  • Linux compatibility changes

License

This project is licensed under the MIT License. See the LICENSE file for more information.

proxxy's People

Contributors

atropa-solanaceae avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

proxxy's Issues

NameError: name 'os' is not defined. Did you forget to import 'os'?

WARNING: Please run pip install hrequests[all] for automated browsing support.
Traceback (most recent call last):
File "C:\Users\bim\Downloads\Python\proXXy-main\proXXy-main\proXXy\proXXy.py", line 588, in
parameters()
File "C:\Users\bim\Downloads\Python\proXXy-main\proXXy-main\proXXy\proXXy.py", line 183, in parameters
banner()
File "C:\Users\bim\Downloads\Python\proXXy-main\proXXy-main\proXXy\proXXy.py", line 126, in banner
os.system("title proXXy -- by Solanaceae")
^^
NameError: name 'os' is not defined. Did you forget to import 'os'?

New Error Never Saw before

hello
i was using old version of the proxy scraper since 2023 but cant remember the version exactly its the one before 2.4 might be
1 version down , lately i reinstall my windows and installed everything again and installed the requirements inside the folder
but 1st time to see error like this from hrequests no idea if it comes from the library itself or the code need tweaks to deal with that
its already scraped proxies rightly after but this error suppose to not be here should be fixed might its affect something else
i cant decide , the checking from your side developer will put things on the right side
sorry for disturb and thanks again hope i got reply soon and fix its really annoying thank you
here you are printscreen of the error
image

Running on headless ubuntu server

This gives an error that looks like,

python3 proXXy.py
HTTP server ListenAndServe: listen tcp: lookup tcp/or re: Servname not supported for ai_socktype
Traceback (most recent call last):
File "/home/proXXy/proXXy.py", line 588, in
parameters()
File "/home/proXXy/proXXy.py", line 183, in parameters
banner()
File "/home/proXXy/proXXy.py", line 126, in banner
os.system("title proXXy -- by Solanaceae")
^^
NameError: name 'os' is not defined

ERROR: Failed building wheel for greenlet

Building wheels for collected packages: greenlet
  Building wheel for greenlet (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Building wheel for greenlet (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [120 lines of output]
ERROR: Could not build wheels for greenlet, which is required to install pyproject.toml-based projects

This is a consequence of using python 3.12+. In order to fix, please revert to python 3.11 -- Currently, the highest tested version is python 3.11.8.

cannot import name 'utils' from 'build'

Traceback (most recent call last):
File "C:\Users\USER\Tools\proXXy\proXXy.py", line 6, in
from build import utils
ImportError: cannot import name 'utils' from 'build' (C:\Users\USER\Tools\proXXy\build_init_.py)

UnboundLocalError == line 192

threads is being accessed before it's assigned a value.

To Solve == initialize it with a default value or assign a value to it before the if statement.

Assuming you have a variable named threads defined somewhere in your script

threads = None # Initialize with a default value or set it based on your logic

AttributeError

Python 3.10.6
Windows 11
Installed last update + last requirements

Traceback (most recent call last):
File "C:\Users\tester\Desktop\proXXy-2.4\proXXy.py", line 221, in
main()
File "C:\Users\tester\Desktop\proXXy-2.4\proXXy.py", line 206, in main
proxies = utils.cproxy_sources()
AttributeError: module 'utils' has no attribute 'cproxy_sources'

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.