info3g / linkedin-scrapper Goto Github PK

LinkedIn scrapper is advanced search result scrapper script build with python selenium and beautifulsoup modules to find all people of different profile in excel sheet

Python 100.00%

linkedin linkedin-scraper python selenium scraper contact scraping

linkedin-scrapper's Introduction

Linkedin People Seach Scrapper

LinkedIn scrapper is advanced search result scrapper to find all people of different profile in excel sheet

Installation:

1. Python

You can install python 3 from https://www.python.org

2. Selenium

You can install selenium using Python Package manager.

command: pip istall selenium

3. Chrome Webdriver

You can install webdriver for chrome browser for selenium from here : https://chromedriver.chromium.org/downloads

Note: Check your Chrome version before download

4. BeautifulSoup

You can install BeautifulSoup using Python Package manager.

command: pip istall beautifulsoup4

5. Xlsxwriter

You can install Xlsxwriter to generate Excel file using Python Package manager.

command: pip istall Xlsxwriter

USE:

step 1 : Install all the above modules

step 2: Downloads this project as linkedin-scrapper-master

step 3: Unzip this file and run this project

Step 4 : Change the username and password in linkedin-scrapper.py file. For changing you can check the Screenshot http://prntscr.com/osg5kq

step 5 : Run the script and enjoy. Now you got your linkedin people search data in excel sheet which readable in and converted in all format.

linkedin-scrapper's People

Contributors

Stargazers

Watchers

linkedin-scrapper's Issues

UnboundLocalError: local variable 'loc' referenced before assignment

Hi,

I am facing this issue while running the script, i have tried stating the variable as global but still facing a error mentioned below

Error Message :-
"
Going to scrape Page 1 data
Traceback (most recent call last):
File "C:/Python27/Automation Testing/Scrapping.py", line 187, in
obJH.start()
File "C:/Python27/Automation Testing/Scrapping.py", line 181, in start
self.getData()
File "C:/Python27/Automation Testing/Scrapping.py", line 115, in getData
'heading': heading, 'loc': loc, 'website': website, 'phone': phone, 'email': email,
UnboundLocalError: local variable 'loc' referenced before assignment

Process finished with exit code 1
"

Is there possibility to scrape without entering the user profile

When bot enter the profile, notification goes to owner of the profile. Don't want to send notification to everyone. Do you think there is a solution for this?

Data isn't written into the excel file

For now, the excel file is created and the coloumn headers are updated, but row by row data isn't getting written. I'm trying to work on a fix

Update Readme

command line change istall to install in Readme files

Can we sponsor you?

Hi @info3g,

I am from Proxycurl, we came across your repo and we would like to sponsor you.

Are you keen?

File is not loaded in the xlsx file

Hi ,

Thanks for the solution.
I have sent the range as (1, 2) and when i run the script its shows that data is scrapped, and then it shows the below mentioned error:-

Going to scrape Page 1 data
!!!!!! Data scrapped !!!!!!

Traceback (most recent call last):
File "C:\Python27\Automation Testing\venv\lib\site-packages\xlsxwriter\workbook.py", line 311, in close
self._store_workbook()
File "C:\Python27\Automation Testing\venv\lib\site-packages\xlsxwriter\workbook.py", line 627, in _store_workbook
raise e
File "C:\Python27\Automation Testing\venv\lib\site-packages\xlsxwriter\workbook.py", line 625, in _store_workbook
allowZip64=self.allow_zip64)
File "C:\Python27\Lib\zipfile.py", line 1207, in init
self.fp = io.open(file, filemode)
OSError: [Errno 22] Invalid argument: 'C:\users\s.m\Desktop\test.xlsx'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:/Python27/Automation Testing/Scrapping.py", line 188, in
obJH.start()
File "C:/Python27/Automation Testing/Scrapping.py", line 183, in start
self.writeData()
File "C:/Python27/Automation Testing/Scrapping.py", line 179, in writeData
workbook.close()
File "C:\Python27\Automation Testing\venv\lib\site-packages\xlsxwriter\workbook.py", line 313, in close
raise FileCreateError(e)
xlsxwriter.exceptions.FileCreateError: [Errno 22] Invalid argument: 'C:\users\s.m\Desktop\test.xlsx'

Process finished with exit code 1

Don't know why it's creating a xlxs file just with headers.

It didn't show any error untill now, but the file has only headers