suddendevelopment / metastream Goto Github PK

either make it work for node using the same file or create a separate component/extension/module that will go in node to work with the browser through IPC.

The usecase is not for it to be used in isolation but may be used with a browser instance. Some things cant be streamed directly to a browser.

communication between the 2 components assumes it's in electron.

port pusher, pubnub, socket.io (new socket.io not wikimedias version), sockjs to metastream format

use shodan as a test

json-stream = https://developer.shodan.io/api/stream

api key=
0ZM3HtWOz5qGkQPZL8SjSuaj7IIearmT

given a file path in a node version, tail a log file as a stream

possible with:
https://github.com/lucagrulla/node-tail

assume file is json object per line. example attached

it's supposed to handle bursty traffic by taking in a batch then slowly advancing the view to see items missed at a rate people can actually understand.

however, after a while it starts getting blank items, that should not happen. should stop before ever showing blank items