Document is empty about twitter-scraper HOT 5 CLOSED

seconded

from twitter-scraper.

Closing due to inactivity 👍

from twitter-scraper.

I am getting this same issue

from twitter-scraper.

I had same error as @LiquidPrototype @thorsummoner
it seems to happen because the r.json in twitter_scraper.py line 26 yields an empty json response for the items_html value

{'has_more_items': False,
 'items_html': '\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n \n',
 'min_position': None,
 'new_latent_count': 0}

breaking the while loop when encountering the empty html seems to avoid the error

while pages > 0:
  try:
      items_html = r.json()['items_html'].strip()
    if not items_html:
        break # exit the loop if the items_html is empty

from twitter-scraper.

Worth checking out my repo I made to get twitter data for bot identification purposes. I was using this repo until it broke for me too. https://github.com/jamesacampbell/botrnot and it is pip3 install botrnot

from twitter-scraper.