Comments (6)
regadas
commented on July 3, 2024
Hi @numbnut not sure if I understand this; They are present in the CRD.
from flink-on-k8s-operator.
numbnut
commented on July 3, 2024
Hi @regadas , thanks for the feedback. I will check again and come back to you. Maybe I managed to deploy a broken CRD.
from flink-on-k8s-operator.
regadas
commented on July 3, 2024
No worries; we are actually improving the deployment process.
from flink-on-k8s-operator.
numbnut
commented on July 3, 2024
Hi @regadas ,
I checked it and you where right about the securityContext. It is existing, but some sub properties are missing. I changed the description and only listed the missing ones. Can you say something about why they have been removed. With the GCP Operator they where working fine. Let me add them here as well.
taskManager / jobManager / image / job
securityContext.privileged
securityContext.allowPrivilegeEscalation
securityContext.readOnlyRootFilesystem
securityContext.capabilities
from flink-on-k8s-operator.
acherla
commented on July 3, 2024
Upping this issue as we are seeing the same issue on our end as well with the latest v0.3.5 release. These seem to be configured in the CRD spec but they are not being picked up when configuring them via the FlinkCluster spec
apiVersion: flinkoperator.k8s.io/v1beta1
kind: FlinkCluster
metadata:
name: flinkjobcluster-sample
spec:
flinkVersion: "1.14"
image:
name: flink:1.14.2
jobManager:
accessScope: Cluster
securityContext:
runAsNonRoot: true
runAsUser: 1000
runAsGroup: 1000
privileged: false
ports:
ui: 8081
resources:
limits:
memory: "2048Mi"
cpu: "500m"
taskManager:
replicas: 2
securityContext:
runAsNonRoot: true
runAsUser: 1000
runAsGroup: 1000
privileged: false
resources:
limits:
memory: "2048Mi"
cpu: "500m"
job:
jarFile: ./examples/streaming/WordCount.jar
className: org.apache.flink.streaming.examples.wordcount.WordCount
args: ["--input", "./README.txt"]
parallelism: 2
restartPolicy: Never
securityContext:
runAsNonRoot: true
runAsUser: 1000
runAsGroup: 1000
privileged: false
flinkProperties:
taskmanager.numberOfTaskSlots: "1"
from flink-on-k8s-operator.
regadas
commented on July 3, 2024
Closing this issue in favor of #241 which outlines why these properties are missing.
from flink-on-k8s-operator.
Related Issues (20)
- Cluster stuck in Updating state if PodDisruptionBudget is set
- Wrong job status after job update.
- Rework examples
- Allow Flink to ignore savepoint on restore if the states of the old and new jobs are incompatible
- Create a new cluster before deleting the old one on the job update
- FlinkCluster stuck in Updating state when PDB is used.
- Add HorizontalPodAutoScaller properties to FlinkCluster spec HOT 1
- QUESTION: how to get sample app WordCount.jar to run with version 1.15.3 and 2 taskmanager replicas HOT 3
- Caused by GSSException: No valid credentials provided(Mechanism level: Failed to find any Kerberos tgt)
- Validation Error `nodeaffinity` rule for the flinkcluster HOT 2
- HPA not creating new pods on scale event HOT 3
- Pod Affinity Feature Causing Flink Pipeline Redeployment to Fail HOT 2
- poddisruptionbudget is not allowing any disruptions HOT 1
- While using application mode, the jobmanager pod is not restarted when killed
- Flink Operator Loses Job Manager Contact during EKS upgrade HOT 10
- Question: is the latest CRD backwards compatible with the CRD from 0.30 HOT 3
- Job Manager is not brought back up HOT 1
- Application mode Job Manager restart can create multiple FlinkJobs
- Streaming Application mode Jobs can sometimes reach completed stage
- If the job submitter fails, the job keeps running
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from flink-on-k8s-operator.