Comments (4)
spec. template. driver.env
is set by webhook which listen port 8080, one way to fix this is use default port setting in values.yaml like:
webhook:
enable: true
port: 8080
the other way is to set spark operator param '--webhook-port' to your port 443
from spark-operator.
@imtzer I updated the port to point to 8080
like you described, but I'm still not seeing the environment variables added. What's the reason for updating the port?
from spark-operator.
@imtzer I updated the port to point to
8080
like you described, but I'm still not seeing the environment variables added. What's the reason for updating the port?
spec.template.driver.env
is patched in webhook,webhook default port is 8080,or you can remove webhook.port
to use default value
Also, you have set webhook.namespaceSelector
, this will lead to webhook only run on object having the same key=value label, if you do not need the feature, you can remove it and webhook will run on everything
from spark-operator.
@imtzer That was it! The problem was the namespaceSelector
. When I took that out the environment variables showed up. Thank you so much!
from spark-operator.
Related Issues (20)
- Submitting spring boot spark job via spark Kubernetes operator HOT 1
- [BUG] Contents of `examples` directory do not function out of the box due to incorrect serviceaccount name HOT 1
- [BUG] spark-operator-spark serviceaccount lacks necessary permissions HOT 2
- [QUESTION] spark-submit not called, and other questions HOT 6
- [BUG] Failed to pull image "gcr.io/spark-operator/spark:v3.1.1" HOT 5
- [ERROR] Error initializing SparkContext
- [QUESTION] configmap not found HOT 1
- Custom environment variables provided in Kubernetes spark job is not getting picked up HOT 2
- [BUG] spark.eventLog.enable and spark.eventLog.dir not working HOT 2
- [FEATURE] integrate this operator into training-operator
- [FEATURE] Upgrade default image to Spark 3.5.1
- [BUG] Executor state map becoming too large can result in failures to write the CR to etcd
- how works cache or persist with Spark Operator
- [FEATURE] Manage Spark History Server as a deployment via the Spark Operator helm chart. HOT 10
- [BUG] Spark operator not create enough ingressURL when create batch sparkapplication
- [QUESTION] Error related with webhook HOT 3
- Helm chart references non-existent version `v1beta2-1.4.2-3.5.0` HOT 3
- [BUG] spark-operator v1beta2-1.4.2-3.5.0 install with helm timeout HOT 4
- Add support for livenessProbe and ReadinessProbe of driver and executor pods HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from spark-operator.