clymene-project / clymene Goto Github PK

Change Prometheus timestamp format to elasticsearch timestamp format

The gateway component should receive timeseries and log and deliver it to the designated storage, respectively.

Hello.

First of all, thank you again for your modification that "loki.yaml" namespace problem.
I am very sorry that bother you again.

I am not familiar with k8s system however, trying to solve it so It will be very appreciate for your support.

Currently faced with CrashLoopBackOff Issues and having struggle with it.
Enveloped photos for detail.

Sincerely thank you for your efforts and I'll look forward to your reply.

Added split transmission function when sending timeseries

Design a trace agent using eBPF

Describe the bug
A clear and concise description of what the bug is.
When the storage_type of gateway is set to kafka and storage_type of ingester is set to prometheus, abnormal operation occurs.

To Reproduce
Steps to reproduce the behavior:

1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

ingester logs

Desktop (please complete the following information):

• OS: [e.g. iOS] fedora
• Browser [e.g. chrome, safari]
• Version [e.g. 22] 36

Additional context
Add any other context about the problem here.

Separate the prometheus option and the cortex option to block confusion

Metrics factory is not properly linked for each storage

https://prometheus.io/docs/prometheus/latest/configuration/configuration/

Describe the bug

I want to collect Clymene's metrics and use them for performance analysis.

Hello I`m a DevOps engineer who got interested in Clymene

I have read the blog post and came to this Github to use Clymene how it works on the k8s cluster

But it seems like I have misconfigured the app but could not find the solution.

So the issue is that when I configure the prometheus remote url the agent saids that the option does not exist.

Were there any updates?

below is my deployments.yaml file

apiVersion: apps/v1
kind: Deployment
metadata:
  name: clymene-agent
  namespace: clymene
  labels:
    app: clymene-agent
spec:
  selector:
    matchLabels:
      app: clymene-agent
  replicas: 1
  template:
    metadata:
      labels:
        app: clymene-agent
    spec:
      containers:
        - name: clymene-agent
          image: bourbonkk/clymene-agent:latest
          imagePullPolicy: Always
          ports:
            - containerPort: 15691
            - containerPort: 15692
          args:
            - --config.file=/etc/clymene/clymene.yml
            - --prometheus.remote.url=http://prometheus.monitors.svc.cluster.local:9090/api/v1/write
            - --log-level=info
          env:
            - name: TS_STORAGE_TYPE
              value: kafka
          volumeMounts:
            - mountPath: /etc/clymene/
              name: config-volume
      volumes:
        - name: config-volume
          configMap:
            name: clymene-agent-config
      securityContext:
        runAsUser: 1000

And the error is

Error: unknown flag: --prometheus.remote.url

Is there something wrong with my yaml file? or did I miss something?

If you have time please let me know : )

component

1. clymene-agent

• kafka write
• prometheus write
• cortex write
• elasticsearch write

2. clymene-ingester(Optional)

• consume kafka message
• write prometheus, cortex, elasticsearch

I'm studying ebpf technology, so should I collect all the metrics at the Node level using this?