Comments (2)
sritchie
commented on May 2, 2024
Hey @fwilliams ! I suspect that this is a case of not having a service account key set up yet. I'll see what I can do replicate on my end and see if we can get a better error, vs passing the timeout 429 back directly.
I sent some notes offline and managed to get a job submitted to your project. let me know if this guess is correct. The info for service account key setup lives here: https://caliban.readthedocs.io/en/latest/getting_started/cloud.html
Good luck, and let me know!
from caliban.
sritchie
commented on May 2, 2024
We tracked this down internally at Google, and it looks like was a case of V100 GPUs being unavailable on this particular project. The 429 response is overloaded to mean "no quota" AND to mean that our submissions are being rate limited. I've submitted a bug internally to see if we can get these cases distinguished.
@fwilliams , closing this for now. Thanks again!
from caliban.
Related Issues (20)
- HTTP Error 403: Forbidden HOT 3
- ModuleNotFoundError: No module named 'google' HOT 2
- Issue with caliban package with installing using pip HOT 3
- distirbuted training
- Upgrade to modern dependencies [project]
- [JOSS review] community guidelines HOT 2
- Feature request: support REES HOT 1
- "Failed to read the container uri ... Please make sure that CloudML Engine service account has access to it"
- `caliban cloud`: providing project ID through CLI fails HOT 1
- Create base image based on Ubuntu 20.04 LTS HOT 2
- A way to provide my own docker image? HOT 3
- Cannot create cluster HOT 5
- Insufficient quota in GCP free trial account HOT 2
- Missing newlines in generated Dockerfile when using GCP credentials HOT 1
- Docker image is rebuilt for every `cluster job submit` HOT 12
- Documentation: Caliban Default Creds HOT 8
- Google-auth is not installed automatically
- Make caliban fall back to cpu-only gracefully for local or shell commands HOT 1
- Provide Base Docker Image for CUDA 11
- Looking for a strangely-named image HOT 12
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from caliban.