tufayellus / linkedin-scraper Goto Github PK

A LinkedIn Scraper to scrape up to 1k LinkedIn profiles(due to LinkedIn limit) from company profile links and save their e-mail addresses if available!

License: GNU General Public License v3.0

Python 100.00%

linkedin linkedin-scraper linkedin-bot leads email-scraper scraper-engine scraper email-marketing digital-marketing crawler

linkedin-scraper's Introduction

About Me ❔

It's Tufayel Ahmed. With a graduation degree in Computer Science & Engineering from Leading University, in Sylhet, Bangladesh(I Graduated in April 2020), I am currently serving customers with my Software Engineering skills as a freelancer on Fiverr and other marketplaces. I achieved an honorable position in the Fiverr marketplace (Top Rated Seller) with my highest quality service. I started my freelancing career in April 2017 and completed over 650 projects with five-star level customer satisfaction with many clients from different countries till 5th August 2023(check references provided below to confirm the claim). If you are looking for automated bots, web scrapers, web crawlers, monitoring software, automated alert solutions, and similar, you're welcome anytime. I offer reasonable prices for such services ensuring high quality software experience. If you're not a tech enthusiast, no worries about anything too as I instruct everyone with all the usage processes. Just so you know, please do not ask for anything that doesn't comply with those platform rules as I won't be able to offer anything that violates any rule.

👨‍💻 Competitive/Sports Programming/Problem Solving Achievements

↪️ Ranked 96th/150th in ACM ICPC Dhaka Regional 2017 Programming Contest (Team Contest) [View RankList]

👨‍💻 Competitive/Sports Programming/Problem Solving Profiles

↪️ Stopstalk Profile
↪️ CodeForces Profile
↪️ CodeChef Profile
↪️ HackerRank Profile
↪️ UVa Profile

💪 Skills

↪️ Python (Experience: 6+ years)
↪️ Django Web Application Framework (Experience: Learning)
↪️ Flask Web Application Framework (Experience: Just enough to handle projects)
↪️ PHP (Experience: 3+ years)
↪️ Laravel Web Application Framework (Experience: 6 months)
↪️ jQuery (Experience: 1+ year)
↪️ JavaScript (Experience: 1+ year)
↪️ C# (Experience: 1+ month)
↪️ MySQL (Experience: Enough to use on projects as required)
↪️ SQLite3 (Experience: Enough to use on projects as required)

🌷 Area of Interest

↪️ Web Scraping Automation
↪️ Data Parsing Automation
↪️ Data Manipulation
↪️ Web Automation
↪️ Agile Development

🔧 Specialization

↪️ Google IT Automation with Python

📘 Certification

↪️ Python Basics for Data Science
↪️ Python Data Structures
↪️ Crash Course on Python

💻 Operating System Experience

↪️ Windows
↪️ Linux
↪️ Mac OS

🎌 Freelancing Portfolio

↪️ Fiverr (600+ projects completed) 🔥 Top Rated Seller 🔥 Since July 2021 [Snapshot (26 Jan 2024)]
↪️ Upwork (40+ projects completed) 🔥 Ex Top Rated Freelancer 🔥[Snapshot (8 May 2021)]
↪️ Guru.com (20+ projects completed) [Snapshot (30 Jan 2024)]
↪️ SeoClerk [Snapshot (30 Jan 2024)]

📨 Where to Reach Out

↪️ LinkedIn
↪️ Twitter
↪️ Facebook

linkedin-scraper's People

Contributors

Stargazers

Watchers

linkedin-scraper's Issues

No results :

Logged in to LinkedIn!
Collecting all company member profiles upto 10000!
Requesting page 1 for company ID 10953582
Response received: {'status': 404}
No data available in response
Profile list collected and saved! Extracting emails ...
Scanning 0 profiles

Would you know how to solve this ?

Unable to find the API Links

Hello Sir, I'm unable find the API link that you have given in the code, I could find a similar API link after logging into LINKEDIN inside the Networks tab from inspect elements. But when I use that link in python its throwing me a error.

Please let me know where to find these two API Links it would be of great help to me.
api_link = 'https://www.linkedin.com/voyager/api/organization/companies?decorationId=com.linkedin.voyager.deco.organization.web.WebCompanyStockQuote-2&q=universalName&universalName={}'.format(quote(company_username))
resp = self.s.get(api_link, headers=headers).json()

resp = self.s.get('https://www.linkedin.com/voyager/api/search/blended?count=10&filters=List(currentCompany-%3E{},resultType-%3EPEOPLE)&origin=COMPANY_PAGE_CANNED_SEARCH&q=all&queryContext=List(spellCorrectionEnabled-%3Etrue)&start={}'.format(company_id,(int(page_no)-1) * 10), headers=headers).json()

this command returns error

for page_no in range(2,page_count+1):
profile_list.extend(connection.listProfiles(company_id, page_no))

IndexError: list index out of range

Traceback (most recent call last):
File "CompanyWise_Leads.py", line 170, in
profile_list.extend(connection.listProfiles(company_id, page_no))
File "CompanyWise_Leads.py", line 114, in listProfiles
profiles = resp.get('data').get('elements')[0].get('elements')
IndexError: list index out of range

error finding email

Hi after installing all requirements with pip3 / python3.
I than enter my email and password if a valid linedin account inside: linkedin_email = and linkedin_password = and I than put the link of the company's linkedin inside target_company_link =
and when I run python3 Random_Scraper.py or python3 CompanyWise_Leads.py
I get this:

Logged in to LinkedIn!
Collecting all company member profiles upto 10000!

Traceback (most recent call last):
  File "................/linkedin-email/Random_Scraper.py", line 170, in <module>
    profile_list.extend(connection.listProfiles(company_id, page_no))
  File "................/linkedin-email/Random_Scraper.py", line 116, in listProfiles
    profiles = resp.get('elements')[0].get('elements')
IndexError: list index out of range

What should I do to fix it?
I'm on Python 3.10.2 and pip 22.2.

1K results or 10K results?

Hello,

Everytime I launch this script, I scrape 1000 results. In the About section, you mention that this script can "scrape up to 10k LinkedIn profiles from company profile links". How can we harvest 10K profiles?

Notes:

I select companies that have +10K employees (of course)
I have changed the Do-For loop (that was set to 1000 iterations) to 10K iterations
I am using a newly created Linkedin free account. Shall I use an old warmed up account? One with a Premium subscription?

Unable to login

i have problem with login. email and password already correct. but unable to login to linkedin,