narkhedesam / proxy-list-scrapper Goto Github PK

I tried to retrieve all proxies, but this error is raised

requests.exceptions.InvalidSchema: No connection adapters were found for "('https://www.sslproxies.org/',)"

Here is my code

if __name__ == "__main__":
    # links = read_links('Links.txt')
    scrapper = Scrapper(category='ALL', print_err_trace=False)
    data = scrapper.getProxies()
    for item in data.proxies:
        print('{0}:{1}'.format(item.ip, item.port))
    print('Length : {0}'.format(data.len))

Do you have any idea how to fix this error ?

I tried to update requests module, but it doesn't work

pip3 install requests==2.23.0

thanks for code but i will be happy if u guys can add proxy type like the proxy| port |type

Just a new proxy list with free api:
http://pzzqz.com

In some request you should know if the proxy is http or https, some lists have both

There exists some other similar libraries. From what I can tell the most complete is https://github.com/JaredLGillespie/proxyscrape

It would certainly make sense to cooperate instead of working separately if there are no good reasons against that...?

Describe the bug
When call SPY.ME category, result is empty list

To Reproduce
Steps to reproduce the behavior:
scrapper = Scrapper(category='SPYS.ME', print_err_trace=True)
scrapper_proxies_full = scrapper.getProxies() # Blank result

Expected behavior
Proxies populated in result list.

Screenshots
N/A

Desktop (please complete the following information):

• Python 3.7 Macos, latest version (0.2.1)

Smartphone (please complete the following information):
N/A

Additional context
I think you should work with "elif" instead of "if" in Scrapper._get() method.
Great work, thanks.

https://github.com/zloi-user/hideip.me