tampe125 / hashtag-scraper Goto Github PK

Hi, i keep getting this error after a minute or so of running

Traceback (most recent call last):
File "hashtag-scraper.py", line 135, in
scraper.run()
File "hashtag-scraper.py", line 96, in run
for tweet in tweets:
File "/usr/local/lib/python2.7/dist-packages/twitter/api.py", line 4383, in GetStreamSample
for line in resp.iter_lines():
File "/usr/local/lib/python2.7/dist-packages/requests/models.py", line 720, in iter_lines
for chunk in self.iter_content(chunk_size=chunk_size, decode_unicode=decode_unicode):
File "/usr/local/lib/python2.7/dist-packages/requests/models.py", line 679, in generate
raise ChunkedEncodingError(e)
requests.exceptions.ChunkedEncodingError: ('Connection broken: IncompleteRead(0 bytes read, 203 more expected)', IncompleteRead(0 bytes read, 203 more expected))

Do you know why this happens, how to fix this or what to do

Thanks

Hi tampe125,

Great tool you made love it! but i found a bug when using the --l option with the language code nl which stand for the Dutch lang no output is shown.
I also tried it with the language code de.

When running your tool without any options within a couple of minutes the first 100 words are fetched. when running it with the -l nl option it is stuck on the text "14:25:33|[INFO] Got stream, starting to analyze tweets"

Thanks in advance.

-l --lang , You mention en is default although if i want another lang do we use the standard 2 letter abbreviations, ie: de and fr.

On the first pass I scraped 17k hashtags although it took sometime (4h30m), now if I where to re-run would the scraper likely find duplicates?

Great work and nice idea btw.