Very slow performance when sending on a socket. about lz4 HOT 4 CLOSED

Hello,

Block dependency will definitely introduce bottlenecks, however the Go implementation should not be slower than the js one.
It's been a long time since I wanted to revisit this (it is my first go project and used this implementation as a learning exercise) and I may do so on my free time (so dont expect any quick fix unfortunately).

Thanks for the test case, it will help in figuring out what is going on.

from lz4.

Thanks for looking into it! Adding a bufio.Writer so that the output is buffered before being sent is not helping either.

I am also having issues in interoperability between Node.js and Go when Go sends, but I am not sure about why.

from lz4.

I have revisited the implementation and it is much faster now (getting the throughput from 24k events/s to 10millions/s).
I have dropped support for BlockDependency though as it adds complexity for no real benefit (at least in the tests that I have carried out).

I am unsure about the NodeJS / Go issues you are running into though. Some sample code would help ;).

from lz4.

BlockDependency is good to have for compatibility purposes when you don't control who is sending and how.

Thanks for the good work!

from lz4.