Comments (3)
@hamelsmu , there is! I have a task on my list to add docs to caliban.readthedocs.io, but the CHANGELOG should provide enough of an example to get you started. Here's the relevant entry:
-
Custom base image support (#39), thanks
to #20 from @sagravat.
.calibanconfig.json
now supports a"base_image"
key. For the value, can
supply:- a Docker base image of your own
- a dict of the form
{"cpu": "base_image", "gpu": "base_image"}
with both
entries optional, of course.
Two more cool features.
First, if you use a format string, like
"my_image-{}:latest"
, the format
block{}
will be filled in with eithercpu
orgpu
, depending on the mode
Caliban is using.
How to use
To be more clear than the above:
- Create a file called
.calibanconfig.json
in your project, with contents that look like
{"base_image": "ubuntu:18.04"}
or
{
"base_image": {
"cpu": "cpu_base_image",
"gpu": "gpu_base_image"
}
}
In the first case, GPU and CPU mode will use the same base image. In the latter case you can configure separate custom base images for each mode. THe CHANGELOG references a format string trick too, if you want to use that.
Hope this helps, @hamelsmu !
from caliban.
@hamelsmu also please let me know if you run into any trouble, or have any more questions. Awesome that you're giving Caliban a try.
from caliban.
Thanks so much for your guidance @sritchie ❤️
One more question. What I am trying to do is:
- Assume I have a docker image with Jupityer installed with jupyter server running as the entrypoint
- I want to spin up a VM on GCP with this docker container started, with the correct ports open to allow me to access the running Jupyter server
- I would love to optionally get a URL back so that I can access this directly that is
https://
(so I don't get the ugly chrome warning when trying to access).
I see that this tool allows me to run workloads in the cloud what about Jupyter Notebook in the cloud with the Docker Image, is this Caliban
the right tool doing this on GCP, you think?
My use case is that I want to create a GitHub Action that is automatically triggered when a repo is forked and optionally spins up a Jupyter Notebook automatically for users on GCP, when someone inputs their credentials. I was trying to use a really high-level abstraction like this one to start with, but it could be that perhaps I'm thinking about it the wrong way. BTW: my apologies if this is more of a GCP question and not a caliban
question as my intention is not to abuse this as a forum for GCP questions, so will be happy to redirect my question if this is not appropriate to ask in this issue.
Thanks again for your help. Either way I am going to definitely try to use this as it is super cool
from caliban.
Related Issues (20)
- HTTP Error 403: Forbidden HOT 3
- ModuleNotFoundError: No module named 'google' HOT 2
- Issue with caliban package with installing using pip HOT 3
- distirbuted training
- Upgrade to modern dependencies [project]
- Caliban should fail more gracefully when Docker isn't available
- Convert Caliban to Vertex AI from Cloud AI Platform
- Convert Caliban from Container Registry to Artifact Registry
- `caliban cloud`: providing project ID through CLI fails HOT 1
- Create base image based on Ubuntu 20.04 LTS HOT 2
- Cannot create cluster HOT 5
- Insufficient quota in GCP free trial account HOT 2
- Missing newlines in generated Dockerfile when using GCP credentials HOT 1
- Docker image is rebuilt for every `cluster job submit` HOT 12
- Documentation: Caliban Default Creds HOT 8
- Google-auth is not installed automatically
- Make caliban fall back to cpu-only gracefully for local or shell commands HOT 1
- Provide Base Docker Image for CUDA 11
- Looking for a strangely-named image HOT 12
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from caliban.