Java compress data can not be decompress about lz4 HOT 5 CLOSED

yes, I also find the question:

if bytes.EqualFold(contentEncoding, []byte("lz4")) {
		b = make([]byte, 200*1024*1024)
		_, err = lz4.UncompressBlock(remoteResp.Body(), b)
		if err != nil {
			checklist.CheckList("fetchAllDataFromMdbStore", "ReadAllDataFromMdbStoreClient-lz4-fail", checklist.Local_Ip, err.Error(), 1, 0)
			return 0
		}

debug stack:

call  len(remoteResp.Body())   18124338
call len(b)   209715200

the dst is enough larger than the encode/decode src. but still can not decode.

result in: invalid source or destination buffer too short

from lz4.

I think these errors that I've encountered in Syncthing (which uses this library to compress data in transfer) could possibly be related too.

• https://forum.syncthing.net/t/connection-dropped-in-loop-with-decompressing-message-lz4-invalid-source-or-destination-buffer-too-short/18796
• syncthing/syncthing#8484

In short, here the problem only seems to affect the i386 release, and also only occurs when decompressing specific files. The last working version is v4.1.13, while v4.1.15 is broken. There were 24 commits between v4.1.13...v4.1.15, so it's probably one of them that is likely the culprit.

from lz4.

Here's a test case to reproduce the failure: #191

from lz4.

I've done more testing, and v4.1.14 also seems to work fine, so the issue is down to something changed between v4.1.14...v4.1.15.

from lz4.

It's the commit 7e764f7 that broke it.

from lz4.