Comments (1)
@markcmiller86 This looks interesting but I'm not sure how to best expose zfp through such an API since zfp fundamentally operates on multidimensional arrays, whereas the API seems geared toward streams of numbers. The I/O stream would somehow have to know about array dimensions and/or strides for this to work well. There's a similar problem of specifying compression settings, e.g., error tolerance. I've not had a chance to take a close enough look at the I/O library to see if there's an easy way to incorporate that. Perhaps one could use something similar to the C++ stream manipulators like std::set_precision()
to specify compression settings and array metadata.
The only other alternative I can think of is to have the user reorganize the data into contiguous blocks, but even then zfp wouldn't know what the dimensionality of the data is (1D, 2D, 3D, ...).
from zfp.
Related Issues (20)
- 16-bit integer support HOT 3
- CUDA backend ignores ZFP_WITH_TIGHT_ERROR
- Is safe to read values in parallel from a const_array with cache_size=0 ? HOT 3
- race condition when using private_const_view from inside oneapi::tbb:parallel_for lambda HOT 13
- The predicted maximum compressed capacity is much larger than the actual HOT 2
- oldest-supported-numpy Erroneously Required in Apple Silicon Python 3.10 Wheel HOT 30
- Python binding installation fails HOT 18
- ppc32: index.hpp: error: integer constant is too large for ‘unsigned long’ type HOT 3
- How to run zfp as a c code with gcc HOT 6
- Is psnr formula error in ZFP? HOT 2
- Missing `void` in functions that take no parameters
- Tiny but above subnormal numbers not handled correctly
- Numpy 2.0 HOT 9
- Cuda mode ZFP examples HOT 4
- Compilation issues with zfp HOT 2
- Running issues with zfp and cuda HOT 3
- Errors reported with scikit-build when running CMake with BUILD_ZFPY enabled HOT 1
- Test failures and segfaults when building with Visual Studio 2022 compiler v14.38.33130 HOT 10
- 2D Point data curiosly compresses way better at 1D HOT 4
- Deserializing const_array HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from zfp.