Comments (4)
benbjohnson
commented on August 16, 2024
Update: HTTP compression was attempted in #155 but it interfered with http.Flusher. Implementing in LTX would allow us to compress once instead of compressing for each replica connection.
from litefs.
buzinas
commented on August 16, 2024
For this type of transfer, zstd might be a good candidate!
from litefs.
benbjohnson
commented on August 16, 2024
I used lz4 on Litestream and it worked pretty well. From my understanding, lz4 is faster but zstd has a better compression ratio. I've found that the compression & decompression speed is usually more important for something like LiteFS rather than eeking out every last byte of compression.
from litefs.
benbjohnson
commented on August 16, 2024
Closed via #249
from litefs.
Related Issues (20)
- Manual editing of data and forcing sync HOT 1
- Windows Support HOT 2
- Working multiple clusters/hiding databases HOT 2
- Retry primary lookup in proxy if not found
- Support for per-database primary on different nodes (regions)? HOT 3
- Continuously flush proxy response HOT 1
- Websocket connection on a replica node HOT 3
- Primary should check backup server before marking ready HOT 1
- Sync and Client API security
- Proxy Server not starting up? HOT 9
- Replication Not Working HOT 8
- Writing to the WAL while using EXCLUSIVE locking mode should be prevented HOT 11
- Support WebSockets in LiteFS Proxy HOT 3
- SQLITE_CONSTRAINT_CHECK error and rollback stops syncing with other nodes HOT 2
- How to test synchorization lag? HOT 1
- Proxy timeout when auto-scaling machines HOT 2
- Consul Key Question, Request for Documentation HOT 1
- Creating new databases HOT 1
- Add the option to act as a real proxy instead of using fly-replay header
- Object Store Mediated Replication HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from litefs.