tufayellus / linkedin-scraper Goto Github PK

Hello,

Everytime I launch this script, I scrape 1000 results. In the About section, you mention that this script can "scrape up to 10k LinkedIn profiles from company profile links". How can we harvest 10K profiles?

Notes:

• I select companies that have +10K employees (of course)
• I have changed the Do-For loop (that was set to 1000 iterations) to 10K iterations
• I am using a newly created Linkedin free account. Shall I use an old warmed up account? One with a Premium subscription?

for page_no in range(2,page_count+1):
profile_list.extend(connection.listProfiles(company_id, page_no))

Hello Sir, I'm unable find the API link that you have given in the code, I could find a similar API link after logging into LINKEDIN inside the Networks tab from inspect elements. But when I use that link in python its throwing me a error.

Please let me know where to find these two API Links it would be of great help to me.
api_link = 'https://www.linkedin.com/voyager/api/organization/companies?decorationId=com.linkedin.voyager.deco.organization.web.WebCompanyStockQuote-2&q=universalName&universalName={}'.format(quote(company_username))
resp = self.s.get(api_link, headers=headers).json()

resp = self.s.get('https://www.linkedin.com/voyager/api/search/blended?count=10&filters=List(currentCompany-%3E{},resultType-%3EPEOPLE)&origin=COMPANY_PAGE_CANNED_SEARCH&q=all&queryContext=List(spellCorrectionEnabled-%3Etrue)&start={}'.format(company_id,(int(page_no)-1) * 10), headers=headers).json()

i have problem with login. email and password already correct. but unable to login to linkedin,

Logged in to LinkedIn!
Collecting all company member profiles upto 10000!
Requesting page 1 for company ID 10953582
Response received: {'status': 404}
No data available in response
Profile list collected and saved! Extracting emails ...
Scanning 0 profiles

Would you know how to solve this ?

Traceback (most recent call last):
File "CompanyWise_Leads.py", line 170, in
profile_list.extend(connection.listProfiles(company_id, page_no))
File "CompanyWise_Leads.py", line 114, in listProfiles
profiles = resp.get('data').get('elements')[0].get('elements')
IndexError: list index out of range

Hi after installing all requirements with pip3 / python3.
I than enter my email and password if a valid linedin account inside: linkedin_email = and linkedin_password = and I than put the link of the company's linkedin inside target_company_link =
and when I run python3 Random_Scraper.py or python3 CompanyWise_Leads.py
I get this:

Logged in to LinkedIn!
Collecting all company member profiles upto 10000!

Traceback (most recent call last):
  File "................/linkedin-email/Random_Scraper.py", line 170, in <module>
    profile_list.extend(connection.listProfiles(company_id, page_no))
  File "................/linkedin-email/Random_Scraper.py", line 116, in listProfiles
    profiles = resp.get('elements')[0].get('elements')
IndexError: list index out of range

What should I do to fix it?
I'm on Python 3.10.2 and pip 22.2.