Comments (35)
@Eric-Zhang1990 Which Docker image are you using? You need to define a kubeconfig in yaml just like https://github.com/caicloud/ciao/blob/master/hack/config.yaml#L1
Then you can run docker run -v {kubeconfig in your host}:/var/run/kubernetes/admin.kubeconfig
. The /var/run/kubernetes/admin.kubeconfig
is defined in your yaml https://github.com/caicloud/ciao/blob/master/hack/config.yaml#L1
from ciao.
Does it solve your problem? In summary, you need copy a config yaml to the image and define the path to kubeconfig, then you could run docker run {kubeconfig in your host}:{kubefig defined in your config yaml}
from ciao.
@gaocegege The Docker image I used is caicloud/ciao:latest that I run command "docker build -t caicloud/ciao ." to build.
I set /var/run/kubernetes/admin.kubeconfig in config.yaml and change the namespaces to "kubeflow", when I run " docker run -v /etc/kubernetes/admin.conf:/var/run/kubernetes/admin.kubeconfig -p 8889:8889 caicloud/ciao", but I don't know wheather path "/etc/kubernetes/admin.conf" is right or not (beacuse I can find kubernetes in /etc).
What do your {kubeconfig in your host} like? Thank you.
from ciao.
@gaocegege Just now I change the Dockerfile: change "COPY ./hack/k8s.config.yaml /etc/ciao/config.yaml" into "COPY ./hack/config.yaml /etc/ciao/config.yaml", my "./hack/config.yaml" is like this:
kubeconfig: /var/run/kubernetes/admin.kubeconfig
namespace: kubeflow
s2i:
provider: configmap
Now the logs is different from what I ask at first time. Now it looks like this:
logs_2.txt
Can you help me see the error? Thank you.
from ciao.
zmq4 was installed with ZeroMQ version 4.3.1, but the application links with version 4.2.5
Your zmq4 does not match.
from ciao.
@gaocegege Is ZeroMQ version 4.3.1 installed in Docker image? And "the application links with version 4.2.5" is installed in my Pc?
How can I install ZeroMQ version 4.2.5 in the Docker image?
Thank you.
from ciao.
I haven't tried it. I used 4.2.5 in my test env. Maybe I can take a look next week.
from ciao.
@gaocegege You mean you have zmq 4.2.5 in your Docker image, right? Can you give me your Docker image to me, let me try it. Because I just reinstall libamq3-dev and it is the newest version 4.2.5.
from ciao.
Sorry I misunderstand it. I am using 4.3.1 locally, not 4.2.5 in Docker image.
from ciao.
But I can reproduce your problem. Now we use apt-get install zmq, it will be 4.2.5. I will take a look next week.
from ciao.
/type bug
from ciao.
@gaocegege Ok, thank you.
from ciao.
@Eric-Zhang1990 If you want to have a try, you can run it locally. Then you will not meet the problem.
from ciao.
@gaocegege I can not run it locally, I have tried it. After I follow the steps, when I run jupyter notebook, it just run jupyter notebook, I mean it does not relate to kubeflow and k8s.
from ciao.
@Eric-Zhang1990 Did you run
Run the script hack/install.sh, then the specification of the kernel will be installed to ${HOME}/.local/share/jupyter/kernels/kubeflow, then Jupyter will know the information about Ciao.
from ciao.
You need to install the kernel spec locally, then run jupyter notebook
. Thus the notebook can find the new kernel.
from ciao.
@gaocegege Yeap, I deploy it following all steps you provide. I can try it again.
from ciao.
Yeah, if you cannot find the kernel in jupyter notebook, please let me know.
BTW, are you using virtualenv or conda?
from ciao.
I use the system python env
from ciao.
I should use conda?
from ciao.
No, system python is better.
from ciao.
Ok, I will try it later. Thanks.
from ciao.
@Eric-Zhang1990 OK, if you have any problem, feel free to ask me here. I am glad to help you
from ciao.
@gaocegege Hi, do you know how to install customed zmq version we want to install in Docker image and our own local Pc, thank you.
from ciao.
https://github.com/zeromq/libzmq/releases
from ciao.
@gaocegege I have autoremove libzmq3-dev and libzmq5, but the error "zmq4 was installed with ZeroMQ version 4.3.1, but the application links with version 4.2.5" still appears, how can I solve it? thank you.
from ciao.
@Eric-Zhang1990 Can you run kernel gateway without the zmq?
I think it should return an error when you run it. I will take a look.
Are you doing the feasibility research on ciao?
from ciao.
@gaocegege We want to use ciao for our distributed training on k8s.
from ciao.
@gaocegege I run it using Dockerized Kernel, you mean I run it using Native?
from ciao.
@gaocegege You say "Can you run kernel gateway without the zmq?", how can I run kernel gateway without the zmq? which is related to "Jupyter Notebook Extension to Kernel Gateway (nb2kg) is used to communicate with the kernel in the docker image"?
from ciao.
@Eric-Zhang1990 I sent my wechat ID to your gmail. You can add me in wechat then we can contact closely.
from ciao.
@gaocegege I check my gmail, I do not recive your eamil, my gmail is "[email protected]"
from ciao.
@Eric-Zhang1990 Sent again, please double-check.
from ciao.
@gaocegege Sorry, I do not receive your eamil, I check it many times, can you give me your eamil, I send my wechat ID to you.
from ciao.
Ok.
from ciao.
Related Issues (20)
- [feature] Cleanup after job is finished HOT 6
- [UX] non-kubeflow backend HOT 5
- [discussion] Why do we need a kernel to do this instead of some cell magics? HOT 3
- [discussion] Is it too heavy to create a kernel to achieve this?
- Add support for ciao using Incluster k8s config HOT 6
- [chore] Replace gometalinter with golangci-lint HOT 3
- [enhancement] Upgrade TFJob/PyTorchJob to v1beta2 HOT 2
- [feature] Support %tensorboard magic command
- Failed to build ciao image HOT 5
- [enhancement] Upgrade TFJob/PyTorchJob to v1
- [feasibility research] Support Customized UI in Jupyter HOT 1
- [bug] zmq4 was installed with ZeroMQ version 4.3.1, but the application links with version 4.2.5 HOT 5
- Kubeflow kernel try to get the pods but failed
- kernel can not started successly if kubeconfig is not set
- Failed to build the image
- Failed to build the image HOT 1
- A Problem HOT 16
- TF_CONFIG environment variable HOT 1
- error msg HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ciao.