Kinesis writable stream that buffers up records

Records written to the stream will buffer up until highWaterMark has been reached, or the stream is closed, before writing to Kinesis using putRecords.

Failed items will be retried up until options.maxRetries has been reached. The initial timeout before the retry is set in options.retryTimeout and it increases by the fibonnaci sequence.

The partition key is by default a random number, but this can be adjusted by overriding streamInstance.getPartitionKey(record).

A bunyan, winston or similar logger instance that have methods like debug, error and info may be sent in as options.logger to the constructor.

var KinesisWritable = require('kinesis-write-stream');

var stream = new KinesisWritable(kinesisClient, 'streamName', {
  highWaterMark: 16,
  maxRetries: 3,
  retryTimeout: 100
});

inputStream.pipe(stream);

See api.md.

MIT