Comments (8)
Just noticed your commit for capture groups (not production ready). The memory consideration will probably not be an issue on the clients in our environment - the flow of metrics will be a constant.
I shall give it a go and report back.
The variables thing would still be nice though.
from carbon-c-relay.
re: patches, beware that I'm very picky about code ;) For the statistics interval change it's a matter of passing on a (command line flag fed) value down to the main loop. It does second sleeps, so, it should be a matter of replacing the hardcoded 60 with the value passed on. Not a big change, feel free to open a separate feature request for it.
from carbon-c-relay.
Is it really necessary to read all environment environment variables? Hostname is already known to the relay (and can be overridden using -H) so that would be slightly easier to use.
from carbon-c-relay.
no, I don't think that all environment variables are needed.How do I use
the variable Hostname set through -H?
I was trying to avoid a situation like:
Server maxwell
aggregate
*.system.cpu-[0-9]+.cpu-idle
every 10 seconds
expire after 5 seconds
compute average write to
maxwell.vbox.cpu-all.average
Server edison
aggregate
*.system.cpu-[0-9]+.cpu-idle
every 10 seconds
expire after 5 seconds
compute average write to
edison.vbox.cpu-all.average
Server beyonce
aggregate
*.system.cpu-[0-9]+.cpu-idle
every 10 seconds
expire after 5 seconds
compute average write to
beyonce.vbox.cpu-all.average
and so on.
With the back references I don't need that and I can just do:
aggregate
(.*).system.cpu.[0-9]+.cpu.([a-z]+)
every 10 seconds
expire after 5 seconds
compute average write to
\1.system.cpu.avg.\2
;
But I am wary that as you said, this is not well tested yet.I will
provide feedback after it has gone through our load test environment.
I also have the unhappy situation where I get a stream of metrics on
each client like:
127.0.0.1.memcached.metrics_cache.df.cache.used
Which is annoying as I want:
maxwell.vbox.memcached.metrics_cache.df.cache.used
Having the hostname (fqdn) available would save a considerable amount of
Puppet cleverness.
Regards and thanks, Carbon C Relay has made my day job easier.
from carbon-c-relay.
Sorry, gentlemen, for interrupting your conversation, but BTW - you can use built-in collectd aggregator plugin for aggregating CPU stats. Something like
LoadPlugin aggregation
<Plugin "aggregation">
<Aggregation>
Plugin "cpu"
Type "cpu"
GroupBy "Host"
GroupBy "TypeInstance"
CalculateSum true
CalculateAverage true
</Aggregation>
</Plugin>
works like a charm...
Just my 5 cents.
from carbon-c-relay.
deniszh
5c well spent.
I did not notice the collectd aggregation plugin.
Ta.
from carbon-c-relay.
Would it be worth to implement something like \H in the replacement code, or can we sufficiently get away with group matches and different input here?
from carbon-c-relay.
assuming all is fine here, please reopen if I overlooked something
from carbon-c-relay.
Related Issues (20)
- Extreme CPU usage from 3.4 > 3.7 HOT 4
- Memory eating when replicating metrics or maybe due to SSL usage HOT 9
- Metrics get lost when lz4 compressed. HOT 2
- Docker image build failed due to Autoconf
- Disabling SSLv3 or other TLS versions (1.0, 1.1) and unsecure ciphers when listening ssl ? HOT 33
- Any way to have multiple threads per carbon_ch destination without duplicating service? HOT 7
- Supporting mTLS (mutual authentication) on the listener so that we may ask the client to prove who it is HOT 13
- Compiling on CentOS 7 with local OpenSSL shared libraries ? HOT 2
- Behavior of any_of doesn't seem inline with docs HOT 3
- Segmentation fault when supervisorctl start ccrelay HOT 11
- Dockerfile: add bison flex dependency for latest build HOT 4
- Do not prefix stats HOT 8
- Internal metrics not sent until restarted HOT 4
- tag values are corrupted HOT 2
- Issue with any_of causing massive lag in metrics reaching their destination HOT 11
- Segmentation fault if any cluster host can not be resolved HOT 6
- Unable to debug rules with -d -t -l flags HOT 4
- quoted expressions stop working properly HOT 10
- Support lz4 and gzip HOT 6
- Rewrite function doesn't work with tags HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from carbon-c-relay.