mirusu400 / proxxy Goto Github PK

• Clone the repository:

git clone https://github.com/Atropa-Solanaceae/proXXy.git

• Navigate to the project directory:

cd proXXy

• Install the required dependencies:

pip3 install -r requirements.txt

• Run the program:

python3 proXXy.py

• Select the execution parameters.

• Allow the program to complete, then check the new text files located in scraped/ directory! (After each instance of the checking process, allow the program time to join threads before moving on to the next proxy protocol.)

The program will output three files in the project directory containing the regularized proxy lists:

• HTTP.txt
• HTTPS.txt
• SOCKS4.txt
• SOCKS5.txt

along with an error output file titled error.log denoting the sources that were unable to be accessed.

The basic syntax for running proXXy is as follows:

python3 proXXy.py [flags]

1. -v[T/F], --validate: Use this flag to enable proxy validation. The scraper will attempt to validate the scraped proxies by checking their accessibility.

2. -th [int], --threads: This flag allows you to set the number of threads to use. The default value is 100 threads.

3. -ti [int], --timeout: This flag allows you to set the default timeout for proXXy. The timeout specifies the number of seconds the scraper will wait for a response before considering a request as failed. The minimum timeout value is 10 seconds.

python3 proXXy.py -vT -th 100 -ti 10

4. -y: This flag allows you to skip the prompts and run proXXy with the given parameters. (Make sure you know what you're doing!)

python3 proXXy.py -vT -th 100 -ti 10 -y

5. -u, --update: This flag is used to update the project. When provided alone, it will trigger the update process, ensuring you have the latest version of proXXy.

6. -h, --help: Use this flag alone to display the help message that explains the available flags and their usage.

Remember to utilize the -h flag whenever you need a quick reference to the available flags and how to use them. The help message will be displayed as follows:

usage: proXXy.py [-h] [-u] [-v {T,F}] [-th THREADS] [-ti TIMEOUT] [-y]

A super simple multithreaded proxy scraper; scraping & checking ~80k HTTP, HTTPS, SOCKS4, & SOCKS5 proxies.

options:
  -h, --help            show this help message and exit
  -u, --update          update project
  -v {T,F}, --validate {T,F}
                        validate proxies (T/F)
  -th THREADS, --threads THREADS
                        number of threads to use, default is 100
  -ti TIMEOUT, --timeout TIMEOUT
                        set the number of seconds for the default timeout (cannot be lower than 5 seconds) 
  -y                    continue without prompts

• The combination of flags -v, -th, and -ti is allowed. However, if -v is set to "F" (disabled), the other flags -th and -ti are not allowed.

• If you choose to enable proxy validation (-v flag), proXXy will display information about the total number of sources and the number of accessed sources after the validation process is completed.

• When using the -u flag to update the project, proXXy will clear the screen and show a status line indicating the update progress. The update process will take a few seconds to complete.

• Migrate to asyncio for faster scraping.
• Implement a feature for automatically testing the scraped proxies to verify their functionality. (2/4th completed)
• Proxy sorting instead of hardcoding.
• Provide an option to discern between Elite, Anonymous, and Transparent anonymity classes of proxies.

Need help and can't get it to run correctly? Open an issue or contact me here

This project is licensed under the MIT License. See the LICENSE file for more information.