justinlittman / twarc-cloud Goto Github PK

And, if I'm reading https://serverfault.com/questions/933250/what-is-the-aws-nat-gateway correctly isn't necessary.

In particular, that it can occur when harvests overlap.

I just discovered twarc-cloud, and I'm very excited about it! Thanks for this awesome tool.

As I've been playing around with it, however, I've run into a few problems. After configuring everything, I was able to successfully collect and download tweets from specific user timelines with the user_timeline collection template and twarc_cloud.py collection schedule /twarc_cloud.py collection download.

However, when I try to collect tweets with the filter and search collection templates, I'm encountering some issues. When I download the tweets, I get a bunch of tweet zip files, but they're all empty.

And when I look at my cluster on AWS, it seems like something's going wrong...

Just wondering if you know what might be happening here, or why twarc-cloud's user timeline functions might be working but not search and filter.