Diff'ing before shuffling: even better "compression" for non-normal data? about c-blosc HOT 2 OPEN

Yes, that is a nice idea. Probably will only work with integers, as this can change the precision in floating point, but worth exploring. Will still have room for at least four different pre-conditioners in Blosc, and what you are suggesting may be good candidate. Would you like to create some PR?

from c-blosc.

In fact, in many cases diff'ing series of IEEE 754 floats as integers is nearly as efficient as calculating the precise floating-point differences. This works if typical delta is less than the typical magnitude (exponent changes rarely), e.g. for measurements of temperature in K, masses, and similar non-negative quantities.

In my experiments, this + bitshuffle did provide better compression compared to plain bitshuffle, and was quite fast.

from c-blosc.