Scraping gets stuck about google-maps-scraper HOT 10 CLOSED

Yes, I am not adding it.

from google-maps-scraper.

Should be fixes in v2

from google-maps-scraper.

Perfect. Socks5 support in V2 too?

from google-maps-scraper.

I don't know how to do it? Could you patch v2 (Once Released) and send me the Code I will learn it.

from google-maps-scraper.

I just see it can be easily done with an argument. https://stackoverflow.com/questions/53082267/how-can-i-set-socks5-proxy-for-selenium-webdriver-python Not necessary to add this to your code.

from google-maps-scraper.

Can you re-open this issue? It's not resolved in V2. Scraper got stuck fetching links exactly at the same place as on the screenshot I added when opening this issue

Stuck for 1 hour now

from google-maps-scraper.

queries:

Header
toyota-europe.com in Belgie
exxonmobil.be in Belgie
janssen.com in Belgie
engie.be in Belgie
be.gsk.com in Belgie
colruytgroup.com in Belgie
services.totalenergies.be in Belgie
basf.com in Belgie
mazda.eu in Belgie
volvocars.com in Belgie
mastercard.be in Belgie
arcelormittal.com in Belgie

config.py:

import csv

with open('input/input.csv', 'r') as file:
    next(file) # drop header
    varlist = [row[0] for row in csv.reader(file, delimiter=",")]
    
queries = [{"keyword": q, "has_website": True, "max_results": 20, } for q in varlist]

But in V1 without using csv and varlist it got stuck at the same place. After Fetching volvocars.com in Belgie. When I pick another random chuck of queries it gets stucks again after fetching 25~ queries.

Edit:
Strange enough. When I place volvocars.com in Belgie at query 11 instead of 13. It gets stuck after 11. It gets stuck after fetching volvocars.com in Belgie. It doesn't matter what search query I put after

from google-maps-scraper.

I took another selection of queries. It keep getting stuck after fetching the 9th query. I run it 4 time in a row to check what happens. Now it gets stuck after fetching the second query every time I run the scraper

from google-maps-scraper.

It has to be a selenium issue. My advice you is to get a friend's computer and run it there, till some one comes and provide solution. As I really don't know why it occurs.

from google-maps-scraper.

@sh3ll4rpw, It was a coding bug, I resolved it please use latest version.

from google-maps-scraper.