seb943 / scrapevin Goto Github PK

➜  scrapeVIN git:(master) ✗ python3 Codes/Scraper_final.py
Results are saved under current directory :  /Users/user/Documents/code/scrapeVIN \Scraped
&order=newest_first
We start to scrape page n° 1
You might need to manually accept the cookies (only necessary at page 1).
 Press Enter to continue when it is done (or not displayed on the site)...
Thanks!
1
Unable to scrape item n°1
2
Unable to scrape item n°2
3
Unable to scrape item n°3
4
Unable to scrape item n°4
5
Unable to scrape item n°5
6
Unable to scrape item n°6
7
Unable to scrape item n°7
8
Unable to scrape item n°8
9
Unable to scrape item n°9
10
Unable to scrape item n°10
/Users/user/Documents/code/scrapeVIN/Codes/functions_FR_BEL_LUX_NL_SPAIN.py:167: FutureWarning: The frame.append method is deprecated and will be removed from pandas in a future version. Use pandas.concat instead.
  DATA_ALL = DATA_ALL.append(scrape_research_page(search_url))
We finished to scrape page n° 1
We start to scrape page n° 2
1
Unable to scrape item n°1
2
Unable to scrape item n°2
3
Unable to scrape item n°3
4
Unable to scrape item n°4
5
Unable to scrape item n°5
6
Unable to scrape item n°6
7
Unable to scrape item n°7
8
Unable to scrape item n°8
9
Unable to scrape item n°9
10
Unable to scrape item n°10
/Users/user/Documents/code/scrapeVIN/Codes/functions_FR_BEL_LUX_NL_SPAIN.py:173: FutureWarning: The frame.append method is deprecated and will be removed from pandas in a future version. Use pandas.concat instead.
  DATA_ALL = DATA_ALL.append(scrape_research_page(search_url))
We finished to scrape page n° 2
We finished scraping the query etro between page 1 and page 2!
Results are saved under current directory :  /Users/user/Documents/code/scrapeVIN \Scraped