drewmcarthur / embedding-firehose Goto Github PK

deployed v1, should update readme to reflect that

should also point to example implementation, or include example in repo

heroku doesn't have any persistent file storage, so looks like i'll have to pay for some postgres somewhere

since we check if we shouldEmbed a list of tokens based on the number of tokens / time since last api call, and make sure that's under some threshold, we're only going to embed the smallest posts as they come in.

we could ignore anything under 5 tokens, or some threshold, but until our desired burn rate gets bumped up, we'll only be consuming the smallest posts

eg stats generated since TIME
had an audience for TIME, Z clients
skipped X% of posts
would cost $Y/day to embed everything