Comments (2)
Adding detailed output from csi driver pod:
% kubectl -n dynatrace describe pod dynatrace-oneagent-csi-driver-5hgmz
Name: dynatrace-oneagent-csi-driver-5hgmz
Namespace: dynatrace
Priority: 1000000
Priority Class Name: dynatrace-high-priority
Node: k8s-worker-2/192.168.1.103
Start Time: Wed, 20 Dec 2023 10:39:58 +0100
Labels: app.kubernetes.io/component=csi-driver
app.kubernetes.io/name=dynatrace-operator
app.kubernetes.io/version=0.15.0
controller-revision-hash=5d8fd4f86f
internal.oneagent.dynatrace.com/app=csi-driver
internal.oneagent.dynatrace.com/component=csi-driver
pod-template-generation=1
Annotations: cluster-autoscaler.kubernetes.io/enable-ds-eviction: false
cni.projectcalico.org/podIP: 172.16.140.44/32
cni.projectcalico.org/podIPs: 172.16.140.44/32
dynatrace.com/inject: false
kubectl.kubernetes.io/default-container: provisioner
Status: Running
IP: 172.16.140.44
IPs:
IP: 172.16.140.44
Controlled By: DaemonSet/dynatrace-oneagent-csi-driver
Init Containers:
csi-init:
Container ID: docker://5f8ffc7d072984434508e243286fd2fcd5b1d364042812c98bc7e0ae8bfec9d4
Image: docker.io/dynatrace/dynatrace-operator:v0.15.0
Image ID: docker-pullable://dynatrace/dynatrace-operator@sha256:0175f28a0176a998bd559adeef1cc69c07e876f4e6fdbc6b02f1cab71eca9179
Port: <none>
Host Port: <none>
Args:
csi-init
State: Terminated
Reason: Completed
Exit Code: 0
Started: Wed, 20 Dec 2023 10:40:16 +0100
Finished: Wed, 20 Dec 2023 10:40:17 +0100
Ready: True
Restart Count: 0
Limits:
cpu: 50m
memory: 100Mi
Requests:
cpu: 50m
memory: 100Mi
Environment: <none>
Mounts:
/data from data-dir (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bjtzj (ro)
Containers:
server:
Container ID: docker://d81ed2bb448474fe6319b7c30e880c0c8854f78e18158f536643a9a2e8316789
Image: docker.io/dynatrace/dynatrace-operator:v0.15.0
Image ID: docker-pullable://dynatrace/dynatrace-operator@sha256:0175f28a0176a998bd559adeef1cc69c07e876f4e6fdbc6b02f1cab71eca9179
Port: 10080/TCP
Host Port: 0/TCP
Args:
csi-server
--endpoint=unix://csi/csi.sock
--node-id=$(KUBE_NODE_NAME)
--health-probe-bind-address=:10080
State: Running
Started: Wed, 20 Dec 2023 10:40:18 +0100
Ready: True
Restart Count: 0
Limits:
cpu: 50m
memory: 100Mi
Requests:
cpu: 50m
memory: 100Mi
Liveness: http-get http://:livez/livez delay=5s timeout=1s period=5s #success=1 #failure=3
Startup: exec [/usr/local/bin/dynatrace-operator startup-probe] delay=0s timeout=5s period=10s #success=1 #failure=1
Environment:
POD_NAMESPACE: dynatrace (v1:metadata.namespace)
KUBE_NODE_NAME: (v1:spec.nodeName)
Mounts:
/csi from plugin-dir (rw)
/data from data-dir (rw)
/tmp from tmp-dir (rw)
/var/lib/kubelet/pods/ from mountpoint-dir (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bjtzj (ro)
provisioner:
Container ID: docker://03339255d2640013cf9553ea1340257bb179070f8af363552df713441a896a40
Image: docker.io/dynatrace/dynatrace-operator:v0.15.0
Image ID: docker-pullable://dynatrace/dynatrace-operator@sha256:0175f28a0176a998bd559adeef1cc69c07e876f4e6fdbc6b02f1cab71eca9179
Port: 10090/TCP
Host Port: 0/TCP
Args:
csi-provisioner
--health-probe-bind-address=:10090
State: Running
Started: Wed, 20 Dec 2023 10:48:35 +0100
Last State: Terminated
Reason: OOMKilled
Exit Code: 137
Started: Wed, 20 Dec 2023 10:47:40 +0100
Finished: Wed, 20 Dec 2023 10:47:53 +0100
Ready: True
Restart Count: 4
Limits:
cpu: 300m
memory: 100Mi
Requests:
cpu: 300m
memory: 100Mi
Liveness: http-get http://:livez/livez delay=5s timeout=1s period=5s #success=1 #failure=3
Environment:
POD_NAMESPACE: dynatrace (v1:metadata.namespace)
Mounts:
/data from data-dir (rw)
/tmp from tmp-dir (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bjtzj (ro)
registrar:
Container ID: docker://6a19aa007e1a1131b6316186c2b5c135f17e7de57b8c5a537a3cb45f602cce7f
Image: docker.io/dynatrace/dynatrace-operator:v0.15.0
Image ID: docker-pullable://dynatrace/dynatrace-operator@sha256:0175f28a0176a998bd559adeef1cc69c07e876f4e6fdbc6b02f1cab71eca9179
Port: <none>
Host Port: <none>
Command:
csi-node-driver-registrar
Args:
--csi-address=/csi/csi.sock
--kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)
State: Running
Started: Wed, 20 Dec 2023 10:40:21 +0100
Ready: True
Restart Count: 0
Limits:
cpu: 20m
memory: 30Mi
Requests:
cpu: 20m
memory: 30Mi
Environment:
DRIVER_REG_SOCK_PATH: /var/lib/kubelet/plugins/csi.oneagent.dynatrace.com/csi.sock
Mounts:
/csi from plugin-dir (rw)
/registration from registration-dir (rw)
/var/lib/kubelet/plugins/csi.oneagent.dynatrace.com/ from lockfile-dir (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bjtzj (ro)
liveness-probe:
Container ID: docker://649e593cc20b790272082c99e52e51eb2a6b843f0db6e15e2a64567bd3cd9d5e
Image: docker.io/dynatrace/dynatrace-operator:v0.15.0
Image ID: docker-pullable://dynatrace/dynatrace-operator@sha256:0175f28a0176a998bd559adeef1cc69c07e876f4e6fdbc6b02f1cab71eca9179
Port: <none>
Host Port: <none>
Command:
livenessprobe
Args:
--csi-address=/csi/csi.sock
--health-port=9898
State: Running
Started: Wed, 20 Dec 2023 10:40:23 +0100
Ready: True
Restart Count: 0
Limits:
cpu: 20m
memory: 30Mi
Requests:
cpu: 20m
memory: 30Mi
Environment: <none>
Mounts:
/csi from plugin-dir (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bjtzj (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
registration-dir:
Type: HostPath (bare host directory volume)
Path: /var/lib/kubelet/plugins_registry/
HostPathType: Directory
plugin-dir:
Type: HostPath (bare host directory volume)
Path: /var/lib/kubelet/plugins/csi.oneagent.dynatrace.com/
HostPathType: DirectoryOrCreate
data-dir:
Type: HostPath (bare host directory volume)
Path: /var/lib/kubelet/plugins/csi.oneagent.dynatrace.com/data
HostPathType: DirectoryOrCreate
mountpoint-dir:
Type: HostPath (bare host directory volume)
Path: /var/lib/kubelet/pods/
HostPathType: DirectoryOrCreate
lockfile-dir:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
tmp-dir:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
kube-api-access-bjtzj:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: Guaranteed
Node-Selectors: <none>
Tolerations: ToBeDeletedByClusterAutoscaler:NoSchedule op=Exists
kubernetes.io/arch=arm64:NoSchedule
kubernetes.io/arch=amd64:NoSchedule
kubernetes.io/arch=ppc64le:NoSchedule
node-role.kubernetes.io/control-plane:NoSchedule op=Exists
node-role.kubernetes.io/master:NoSchedule op=Exists
node.kubernetes.io/disk-pressure:NoSchedule op=Exists
node.kubernetes.io/memory-pressure:NoSchedule op=Exists
node.kubernetes.io/not-ready:NoExecute op=Exists
node.kubernetes.io/pid-pressure:NoSchedule op=Exists
node.kubernetes.io/unreachable:NoExecute op=Exists
node.kubernetes.io/unschedulable:NoSchedule op=Exists
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 8m44s default-scheduler Successfully assigned dynatrace/dynatrace-oneagent-csi-driver-5hgmz to k8s-worker-2
Normal Pulling 8m44s kubelet Pulling image "docker.io/dynatrace/dynatrace-operator:v0.15.0"
Normal Pulled 8m28s kubelet Successfully pulled image "docker.io/dynatrace/dynatrace-operator:v0.15.0" in 1.13s (16.028s including waiting)
Normal Created 8m28s kubelet Created container csi-init
Normal Started 8m27s kubelet Started container csi-init
Normal Pulling 8m26s kubelet Pulling image "docker.io/dynatrace/dynatrace-operator:v0.15.0"
Normal Pulled 8m25s kubelet Successfully pulled image "docker.io/dynatrace/dynatrace-operator:v0.15.0" in 1.079s (1.079s including waiting)
Normal Created 8m25s kubelet Created container server
Normal Started 8m25s kubelet Started container server
Normal Pulling 8m24s kubelet Pulling image "docker.io/dynatrace/dynatrace-operator:v0.15.0"
Normal Pulled 8m24s kubelet Successfully pulled image "docker.io/dynatrace/dynatrace-operator:v0.15.0" in 1.096s (1.096s including waiting)
Normal Created 8m23s kubelet Created container registrar
Normal Pulled 8m23s kubelet Successfully pulled image "docker.io/dynatrace/dynatrace-operator:v0.15.0" in 1.075s (1.075s including waiting)
Normal Pulling 8m22s kubelet Pulling image "docker.io/dynatrace/dynatrace-operator:v0.15.0"
Normal Started 8m22s kubelet Started container registrar
Normal Pulled 8m21s kubelet Successfully pulled image "docker.io/dynatrace/dynatrace-operator:v0.15.0" in 1.056s (1.056s including waiting)
Normal Created 8m21s kubelet Created container liveness-probe
Normal Started 8m20s kubelet Started container liveness-probe
Normal Pulling 2m55s (x2 over 8m25s) kubelet Pulling image "docker.io/dynatrace/dynatrace-operator:v0.15.0"
Normal Created 2m39s (x2 over 8m24s) kubelet Created container provisioner
Normal Started 2m39s (x2 over 8m24s) kubelet Started container provisioner
Normal Pulled 2m39s kubelet Successfully pulled image "docker.io/dynatrace/dynatrace-operator:v0.15.0" in 1.177s (16.231s including waiting)
Warning BackOff 2m9s (x2 over 2m11s) kubelet Back-off restarting failed container provisioner in pod dynatrace-oneagent-csi-driver-5hgmz_dynatrace(dfc3e2bf-2c4c-4627-a97d-18ed9222e907)
from dynatrace-operator.
Thank you for opening a Dynatrace Operator Issue. We've identified and tagged the issue as a "Support request".
Dynatrace responds to requests like these via Dynatrace ONE support rather than Github. This helps our team respond as quickly as possible using the support team's tools and procedures.
Thanks for your help!
from dynatrace-operator.
Related Issues (20)
- Readiness and liveness probe failing with default chart config HOT 1
- Dynakube automatic kubernetes monitoring - Do not override environment settings HOT 3
- Missing cpu/memory request/limits from csi-init container HOT 2
- Dynatrace Operator - Not granting the Dynatrace Operator access to image pulling and managing causes a hard-crash in v0.12.x+ HOT 4
- GKE Autopilot Mutating Webhook Namespace Selector HOT 3
- Missing release notes for operator v0.14.0 HOT 1
- PodDisruptionBudget for DT ActiveGate
- SkipCertCheck doens't work on Operator 14.x HOT 1
- Operator should not depend on cluster.local domain HOT 1
- Add affinity support for DT oneAgent HOT 1
- oneagent-csi-driver provisioner crashes with OOM, resource limit is set too low? HOT 3
- Injection of java agent failed in ARM64 EKS nodes HOT 1
- A potential risk of Dynatrace Operator makes a worker node get the token of any Service Account HOT 1
- Add ability to manage dashboards via Kubernetes manifests HOT 1
- Add support for AWS ecr:GetAuthorizationToken (alternative to imagePullSecret) HOT 2
- Configure Port via Environment Variable WEBHOOK_PORT
- logs - log-level and json-format HOT 2
- `provisioner` container in `dynatrace-oneagent-csi-driver` restarts several times when pod scheduled HOT 1
- Find all monitored pods and find the one-agent version in it. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dynatrace-operator.