danmcinerney / elite-proxy-finder Goto Github PK

Finds public elite anonymity proxies and concurrently tests them

Python 100.00%

elite-proxy-finder's Introduction

elite-proxy-finder

This script was not working for a few months. I just fixed it 7/6/15. Only uses gatherproxy.com now.

Finds elite anonymity (L1) HTTP proxies then tests them all in parallel. Tests each proxy against 3 IP checking URLs including one which is HTTPS to make sure it can handle HTTPS requests. Then checks the proxy headers to confirm it's an elite L1 proxy that will not leak any extra info. By default the script will only print the proxy IP, request time, and country code of proxies that pass all four tests but you can see all the results including errors in any of the tests with the -a (--all) option.

Requirements:

Tested on Kali 1.0.6
Python 2.7
- gevent 1.0
- requests 1.2.0+

If you are on a system with requests <1.2.0 you won't see any output because every test will result in an error referring to the request not having an attribute "elapsed". Use the -a option to check the errors.

Kali has gevent 0.13 in its repo and you will need gevent 1.0 if you want the -s option to work. Works fine with 0.13 other than that.

apt-get install python-dev python-gevent
pip install --upgrade gevent

Usage:

python elite-proxy-finder.py

Show proxies that pass all four tests, their country code, and the time it took for each request to complete. Prints the fastest proxies first.

python elite-proxy-finder.py -s 10

Show only the fastest 10 proxy results.

python elite-proxy-finder.py -a

Show all proxy results including the errors that occurred.

python elite-proxy-finder.py -q

Print only the IP address and port of proxies that pass all four tests.

License

Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:

Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.
Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.
Neither the name of Dan McInerney nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission.

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

danmcinerney.org

elite-proxy-finder's People

Contributors

Stargazers

Watchers

Forkers

taganaka aktau laligg pentatonicfunk jakegn basicscandal tkhieu doctane vaginessa wenzhixue cedric-coroir robadler demogorgonz donmalavita marcmann deedubsau drptbl lr2bmail hesterd awayme zhahaoyu cripperz jsfs2019 qestieve purplehua sharifulgeo avisual gorlemik securextools evil1-2 sh1nu11bi vbs orangepole dot-sean inscriptionweb izhun algotrader-dotcom necroapps gaojuncas dotmark joeyburzynski lisp-the-great firearasi mix376 legendarynacar fosterwei gvsurenderreddy erlangbus mendida ultimatelambda darg0001 andremiras talaikis ajinkya-bhosale l9c olivierh59500 weeshlow danielrholmes nestor needsecurity n4yk clicknull dwilbanks motammem usernamealreadyis torstava micahreich leehayes hadidonk sportsbitenews h0k5 darkcode357 riskaamalia applerich cyladia shiunyi71 seabreg nzkcodes viznu philiphall1990 exploit-inters cat-of-devil 5l1v3r1 black608 blackhat3705 tech96 ahmedsakrr ltgrp thenoobtester fogxploit zkenstein nosorry hartl3y94 xanomorf prometeusdev elijahahianyo

elite-proxy-finder's Issues

checkerproxy + letushide no longer work

letushide.com is offline, checkerproxy.net changed their HTML so the way this script scrapes it no longer works. It's not fun or interesting to scrape IP's from proxy sites especially when they're so prone to changing or going down so I have no intention of fixing this script in the near future.

Small Port Issue

Im getting this issue:

Traceback (most recent call last): File "C:\Users\hayda\Desktop\elite-proxy-finder-master\elite-proxy-finder.py", line 402, in <module> P.run() File "C:\Users\hayda\Desktop\elite-proxy-finder-master\elite-proxy-finder.py", line 64, in run gatherproxy_list = self.gatherproxy_req() File "C:\Users\hayda\Desktop\elite-proxy-finder-master\elite-proxy-finder.py", line 182, in gatherproxy_req gatherproxy_list = self.parse_gp(lines) File "C:\Users\hayda\Desktop\elite-proxy-finder-master\elite-proxy-finder.py", line 198, in parse_gp port = str(int(hex_port, 16)) ValueError: invalid literal for int() with base 16: ' </script>'

Index out of range

Hi Dan
I have gevent 1.2.1, requests 2.14.2 and BeautifulSoup 3.2.1. Python is 2.7.13

Running script I get

$ python elite-proxy-finder.py -a
[*] Your accurate external IP: xxx.xxx.xxx.xxx
Traceback (most recent call last):
File "elite-proxy-finder.py", line 400, in
P.run()
File "elite-proxy-finder.py", line 64, in run
gatherproxy_list = self.gatherproxy_req()
File "elite-proxy-finder.py", line 182, in gatherproxy_req
gatherproxy_list = self.parse_gp(lines)
File "elite-proxy-finder.py", line 195, in parse_gp
hex_port = l.split("'")[1]
IndexError: list index out of range

TypeError: str returned non-string

I get a bunch of errors like this:

Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/gevent/greenlet.py", line 327, in run
result = self._run(_self.args, *_self.kwargs)
File "elite-proxy-finder.py", line 247, in proxy_checker_req
time_or_error = self.error_handler(str(e))
TypeError: str returned non-string (type Error)
<Greenlet at 0x7786ea65cc30: <bound method find_http_proxy.proxy_checker_req of <main.find_http_proxy instance at 0x7786ea96fe18>>('109.236.81.101:35088')> failed with TypeError

Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/gevent/greenlet.py", line 327, in run
result = self._run(_self.args, *_self.kwargs)
File "elite-proxy-finder.py", line 247, in proxy_checker_req
time_or_error = self.error_handler(str(e))
TypeError: str returned non-string (type SysCallError)
<Greenlet at 0x7786ea654370: <bound method find_http_proxy.proxy_checker_req of <main.find_http_proxy instance at 0x7786ea96fe18>>('183.219.20.196:8123')> failed with TypeError

No module named gevent

Command:
py -2.7 elite-proxy-finder.py

Error:
Traceback (most recent call last):
File "elite-proxy-finder.py", line 15, in
from gevent import monkey
ImportError: No module named gevent

I installed gevent using this command "Pip install gevent" but I still get the error.

Errors with gevent

I get following errors:
gevent 1.1.2


 Proxy           | CC  |       Domain          | Time/Errors

Traceback (most recent call last):
  File "/Library/Python/2.7/site-packages/gevent/threadpool.py", line 293, in _on_async
  File "/Library/Python/2.7/site-packages/gevent/event.py", line 415, in __call__
  File "/Library/Python/2.7/site-packages/gevent/event.py", line 336, in set_exception
  File "/Library/Python/2.7/site-packages/gevent/_tblib.py", line 243, in g
  File "/Library/Python/2.7/site-packages/gevent/_tblib.py", line 297, in dump_traceback
  File "/Library/Python/2.7/site-packages/gevent/_tblib.py", line 274, in _init
  File "/Library/Python/2.7/site-packages/gevent/builtins.py", line 86, in __import__
ImportError: No module named platform
<async at 0x109f716e0> failed with ImportError

Traceback (most recent call last):
  File "/Library/Python/2.7/site-packages/gevent/threadpool.py", line 293, in _on_async
  File "/Library/Python/2.7/site-packages/gevent/event.py", line 415, in __call__
  File "/Library/Python/2.7/site-packages/gevent/event.py", line 336, in set_exception
  File "/Library/Python/2.7/site-packages/gevent/_tblib.py", line 243, in g
  File "/Library/Python/2.7/site-packages/gevent/_tblib.py", line 298, in dump_traceback
TypeError: 'NoneType' object is not callable
<async at 0x109f71980> failed with TypeError

Traceback (most recent call last):
  File "/Library/Python/2.7/site-packages/gevent/threadpool.py", line 293, in _on_async
  File "/Library/Python/2.7/site-packages/gevent/event.py", line 415, in __call__
  File "/Library/Python/2.7/site-packages/gevent/event.py", line 336, in set_exception
  File "/Library/Python/2.7/site-packages/gevent/_tblib.py", line 243, in g
  File "/Library/Python/2.7/site-packages/gevent/_tblib.py", line 298, in dump_traceback
TypeError: 'NoneType' object is not callable
<async at 0x109f71c20> failed with TypeError

letushide is down, as is danmcinerney.org

I'll try getting danmcinerney.org back up some time. Letushide is probably not coming back so that should just be eliminated.

missing dependencies

root@kaliiso:~/elite-proxy-finder# python2.7 elite-proxy-finder.py 
Traceback (most recent call last):
  File "elite-proxy-finder.py", line 24, in <module>
    from BeautifulSoup import BeautifulSoup
  File "/usr/lib/python2.7/dist-packages/gevent/builtins.py", line 93, in __import__
    result = _import(*args, **kwargs)
ImportError: No module named BeautifulSoup

Fix with:
pip install beautifulsoup

Error in time column

I get Error instead of time elapsed:

$ python2.7 ./elite-proxy-finder.py  -s 5
[*] 116 high anonymity proxies found
[*] Testing proxy speed against https://www.yahoo.com ...

 Time elapsed         Proxy
Error          | 78.29.9.104:3128
Error          | 188.168.82.131:3128
0:00:01.649750 | 77.43.143.31:3128
Error          | 58.20.228.22:8080
Error          | 183.224.1.30:80

Alls this servers works correctly.

I have debian wheezy and python 2.7

$ pip freeze | grep gevent
gevent==1.0

No module named BeautifulSoup

I tried to run your code and received the following error. Is this still active?

dirtynix@dirtynix:~/Desktop$ python elite-proxy-finder.py -q
Traceback (most recent call last):
File "elite-proxy-finder.py", line 24, in
from BeautifulSoup import BeautifulSoup
File "/home/dirtynix/.local/lib/python2.7/site-packages/gevent/builtins.py", line 93, in import
result = _import(*args, **kwargs)
ImportError: No module named BeautifulSoup

Traceback (most recent call last)

just with -q option

Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/gevent/greenlet.py", line 327, in run
result = self._run(_self.args, *_self.kwargs)
File "elite-proxy-finder.py", line 247, in proxy_checker_req
time_or_error = self.error_handler(str(e))
TypeError: str returned non-string (type SysCallError)
<Greenlet at 0xb642b9dcL: <bound method find_http_proxy.proxy_checker_req of <main.find_http_proxy instance at 0xb644f44c>>('179.124.212.137:80')> failed with TypeError

Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/gevent/greenlet.py", line 327, in run
result = self._run(_self.args, *_self.kwargs)
File "elite-proxy-finder.py", line 247, in proxy_checker_req
time_or_error = self.error_handler(str(e))
TypeError: str returned non-string (type SysCallError)
<Greenlet at 0xb583066cL: <bound method find_http_proxy.proxy_checker_req of <main.find_http_proxy instance at 0xb644f44c>>('118.143.114.130:8080')> failed with TypeError

Wiki gevent item

On the wiki it says to run:

apt-get install python-dev gevent

I think it should be

apt-get install python-dev python-gevent python-pip

gevent error

Hello,

This looks really useful, but after cloning the repository and trying to run it on both OS X 10.9 and Raspbian I keep getting the following error:

Traceback (most recent call last):
  File "elite-proxy-finder.py", line 3, in <module>
    from gevent import monkeyImportError: No module named gevent

Tried to install gevent using Pip but no joy, I'm not very experienced using Linux or Python so I might be missing something entirely obvious! Can you help me out?

Downgrading - script works but proxy list maybe outdated?

Hi Dan,
thank you for sharing your work.

I got to downgrade to gevent 1.0.1 and requests 2.5.3 to comply with SSL security (running python 2.7.6 : http://stackoverflow.com/a/29154908/305883

But all proxies for me are failing.
Maybe list is outdated now?
any follow up for using hydemyass?

bs4

i am operating on raspbian the importation of the lib beautifulsoup caused some issues

"from BeautifulSoup import BeautifulSoup" change it to "from bs4 import BeautifulSoup"

just to help those are stuck there

No results

I am unable to get any results from this tool.
The only cause I can think of may be that the tool is making too many threads/requests simultaneously. Great tool good job would be awesome to have this working.

Output:

root@kali:~/scripts/elite-proxy-finder# ./elite-proxy-finder.py -s 10
[*] Your accurate external IP: xx.xx.xx.xx (redacted)
[*] letushide.com: 77 proxies
[*] gatherproxy.com: 25 proxies
[*] checkerproxy.net: 911 proxies
[*] 533 unique high anonymity proxies found
[*] Testing proxy speeds ...

      Proxy           | CC  |       Domain          | Time/Errors
root@kali:~/scripts/elite-proxy-finder#

letushide.com is now offline

The currently implemented proxy website previously known as "letushide.com" has now gone offline and has not been seen online for sometime now. elite-proxy-finder still works as should but always spits out that it can not find any proxies on "letushide.com".

Suggestion: Maybe replace the "letushide.com" implementation with a similar service ?