Consistent Data Loss over Multiple Pulls about hydrator HOT 5 CLOSED

33% is high, but not unheard of. If you like I can verify if you can share the tweet ids for one of them?

from hydrator.

Sure thing. I appreciate you taking a look. Thanks!
TweetIds_640k.txt

from hydrator.

@thb5018 Here's what I got using twarc instead of Hydrator: 411,724 tweets out of 639,716 -- or 64.3% hydration. How does that compare to what you saw with Hydrator?

from hydrator.

@edsu That is pretty similar. I had 411,909 and 411,908 on two different requests. It appears that it may just be that the collection is somewhat volatile. Thanks for running it through twarc. I wanted to try that, but had trouble inputting my keys into the program.

from hydrator.

Ok, I'm glad that things seem to be similar. One thing you can do if you are interested in working with the original data is privately reach out to the person who collected it and see if they are willing to share it with you for research purposes. Let me know if you have trouble figuring out contact information if the dataset is in the DocNow Catalog.

from hydrator.