Comments (3)
Your usecase is for the Compactor to compact blocks created after 72h, correct? Based on your expectation, I think you should set max-time
rather than min-time
.
min-time
is to compact blocks created within than a time window.
from thanos.
Hi @yeya24 ,
Thanks for your answer.
Actually, I'm currently working on a setup where I intend to retain only raw data for the first 30 days and then use the compactor to downgrade the data. I envisioned the following configuration for this purpose:
thanos-compactor:
image: quay.io/thanos/thanos:v0.30.2
depends_on:
- minio
volumes:
- ./bucket/:/etc/thanos/
command:
- 'compact'
- '--log.level=debug'
- '--data-dir=/data'
- '--objstore.config-file=/etc/thanos/bucket.yaml'
- '--wait'
- '--compact.progress-interval=5m'
- '--retention.resolution-1h=365d'
- '--retention.resolution-5m=90d'
- '--retention.resolution-raw=30d'
- '--min-time=29d'
For now, I'm just testing if the --min-time
parameter works as expected.
According to the thanos documentation :
--min-time=0000-01-01T00:00:00Z
Start of time range limit to compact.
Thanos Compactor will compact only blocks, which
happened later than this value. Option can be a
constant time in RFC3339 format or time duration
relative to current time, such as -1d or 2h45m.
Valid duration units are ms, s, m, h, d, w, y.
It appears I may have misunderstood the purpose of this parameter. To clarify, does "later" in this context imply a range from the current time up to 72 hours ago? If this interpretation is correct, why aren't my newer blocks (those younger than 72 hours) being compacted from 2-hour blocks to 4-hour/8-hour blocks, etc.?
Here a screenshot of my bucket blocks :
from thanos.
Related Issues (20)
- bucketweb: Show block size in details pane HOT 4
- [Store] slice bounds out of range [:1029] with capacity 1024 HOT 4
- Thanos ruler: Alertmanager v0.27.0 /api/v1 endpoints deprecated HOT 1
- receive-distributor: always restart, SIGSEGV and panic HOT 3
- Thanos Ruler: The record and the result of its expression calculated in Thanos Query show significant differences. HOT 4
- prometheus-thanos-sidecar helm chart has incorrect volume mounts, pods error on startup HOT 2
- 0.32.0 caused spike in network traffic HOT 8
- bucketweb: attempting to view overlapping blocks results in error page HOT 1
- store: redis client cache-size >0 results startup error
- Thanos compactor backlog HOT 5
- Automatic detection of memory limits and configure GOMEMLIMIT to match.
- ui: Ability to disable specific query warnings from being displayed
- Tracing: Add missing sampler types HOT 1
- Thanos sidecar doesn't upload full blocks HOT 12
- Blocks UI: Find sources for external labels HOT 8
- Thanos-store: Store Pod is not able to load certain blocks from object storage HOT 1
- query: Internal Server Error unknown targetHealth: "unknown" when trying to open the targets page
- Receive: high in flight requests and high context deadline exceeded and ingestion latency in main branch HOT 9
- Rate query failing from Grafana HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from thanos.