hma-proxy-scraper's Introduction

HMA-Proxy-Scraper

`Hidemyass.com free proxy list is down for now!`

It will be up again in the next few monthes

A node.js module to pull/parse working http(s) proxies from Hidemyass.com

Installation:

$ npm install hma-proxy-scraper

Usage is as follows:

var hma = require('hma-proxy-scraper');

hma.getProxies(function (err,proxies) {
    if(err)
    	throw err
   	
   	console.log(proxies)
});

Output is in the form of key:value --> IP : Port.

{ 
  '202.118.236.130' : '3128',
  '111.11.27.194'   : '80',
  '183.136.221.6'   : '3128',
  '183.207.228.58'  : '80',
  '190.106.66.178'  : '3128',
  '61.55.141.10'    : '81',
  '124.67.215.9'    : '80',
  ...etc
}

hma-proxy-scraper's People

Contributors

Stargazers

Watchers

hma-proxy-scraper's Issues

Scrapoxy 4 is out!

Scrapoxy is a open source proxy aggregator, allowing you to manage all proxies in one place 🎯, rather than
spreading it across multiple scrapers 🕸️.

Smartly designed for efficient traffic routing 🔀, Scrapoxy minimizes #bans and boosts success rates 🚀.

The tech stack is built on the latest NodeJS, Typescript, utilizing the NestJS and Angular frameworks.

Here are the key features:

☁️ Cloud Providers with easy installation: Scrapoxy supports many cloud providers like AWS, Azure, or GCP.
🌐 Proxy Services: Scrapoxy supports many proxy services like Rayobyte, IPRoyal or Zyte.
💻 Hardware materials: Scrapoxy supports many 4G proxy farms hardware types, like Proxidize or XProxy.io.
📜 Free Proxy Lists: Scrapoxy supports lists of HTTP/HTTPS proxies and SOCKS4/SOCKS5 proxies.
⏰ Timeout free: Scrapoxy only routes traffic to online proxies to avoid inactive connection.
🔄 Auto-Rotate proxies: Scrapoxy automatically changes IP addresses at regular intervals.
🏃 Auto-Scale proxies: Scrapoxy monitors incoming traffic and automatically scales the number of proxies according to your needs.
🍪 Sticky sessions on Browser: Scrapoxy keeps the same IP address for a scraping session, even for browsers.
🚨 Ban management: Scrapoxy injects the name of the proxy into the HTTP responses.
📡 Traffic interception: Scrapoxy intercepts HTTP requests/responses to modify headers, keeping consistency in your scraping stack. It can add session cookies or specific headers like user-agent.
📊 Traffic monitoring: Scrapoxy measures incoming and outgoing traffic to provide an overview of your scraping session.
🌍 Coverage monitoring: Scrapoxy displays the geographic coverage of your proxies to better understand the global distribution of your proxies.
🚀 Easy-to-use and production-ready: Scrapoxy is suitable for both beginners and experts (Kubernetes / Helm).
🔓 Open Source: And of course, Scrapoxy is open source, under the MIT license.