Comments (8)
I've the same problem, even though I asked in the slack channel I couldn't get an answer.
Iām using image: quay.io/bentoml/yatai:1.1.13 but its keep getting oom killed in my cluster.
from yatai.
Hi, can you provide the yatai version, also 1.1.13? @a-pichard
from yatai.
Yes i am running yatai 1.1.13
from yatai.
It's been 3 weeks, is there anything that you can give us to understand the reason and possibly how to fix ?
from yatai.
Sorry for the late reply. According to the release notes, I don't think it was introduced in 1.1.13, probably an older version, since the 1.1.13 version only includes a minor fix in helm chart.
If you can provide the version without the memory leak problem will be helpful to find the root cause.
from yatai.
I downgraded to 1.1.11 and memory leak still continues. I checked the processes running inside of the container and this was the only one "/app/api-server serve -c /conf/config.yaml" where it consistently reaches the 3Gi memory limit and gets OOM killed, without any significant increase in workload. The application configuration and Kubernetes setup are standard, with memory limits set as expected. Could you please help identify what might be causing this memory usage spike?
from yatai.
/app/api-server serve
is actually the entrypoint of yatai backend.
cc @yetone
from yatai.
Related Issues (20)
- Error: kaniko(bentoImageBuildEngine) apt-get install error HOT 1
- Error: get Bento CR bentoes.resources.yatai.ai not found HOT 1
- Will yatai login ldap be supported? HOT 1
- Deploy a "custom Bentoml image" using "yatai-deployment".
- Support labels from values.yaml
- Error: YAML parse error on yatai/templates/deployment.yaml HOT 4
- Installation of yatai-deployment failed to [ERROR registerYataiComponent...] HOT 5
- Provide a way to disable home page cards
- Cannot access web ui HOT 1
- can not start dashboard when running yarn start HOT 3
- Autoscaling LLM HOT 2
- how to deploy with cutom-runner HOT 1
- Does yatai deployment require saving the model to the bentos model store? HOT 2
- Yatai 2.0 Proposal HOT 2
- Support BentoML 1.2 in Yatai HOT 1
- How can I deploy bentoDeployment with both remote runner and embedded runner?
- How can I host the yatai image in a private registry HOT 3
- Request to set the root path of the Dashboard
- Unable to reset password
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
š Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ššš
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ā¤ļø Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from yatai.