Comments (7)
Looks like it's leaking CPU cycles too:
from indexer.
Looks like indexer-agent
and indexer-service
still have a memory leak problem. I've been using a Kubernetes CronJob
to automatically restart them every day to keep memory usage under control. Here's a gist for anyone that wants to do the same: https://gist.github.com/chriswessels/8271f82a0ae7342d7d0822ea1e796246
from indexer.
I'm also observing this issue on v0.18.6. However I've found a good way to accelerate it: send lots of GraphQL queries to the indexer-agent
management endpoint. I've also noticed that the queries would take longer to execute as memory usage grows.
However I am not sure if certain types of queries are worse than others. Read below.
Context
As @fordN and @chriswessels already know, I'm currently running experiments that require constantly updating the Agora models. In this particular case, I am updating the model variables for each subgraph every 3 minutes.
In the plot below, every drop is the OOM killer killing the indexer-agent
. The frequency increased around May 10th, when I deployed my experiment to the indexer.
from indexer.
Update: The problem is still present on v0.19.2.
from indexer.
Update: immediately preceding the OOM crash, queries begin failing. This causes a drop in quality of service.
from indexer.
Update: the problem is still present on v0.20.12
from indexer.
Figment appears to be experiencing this issue too (shared with me on March 14, 2024)
from indexer.
Related Issues (20)
- Make call cache a config option for Indexers with locally hosted RPC nodes HOT 1
- Network Subgraph's latest indexed block () is higher than Network's latest block () HOT 1
- Fixup current release HOT 3
- Add support for Fuse subgraphs HOT 1
- Figure out Issue regarding sequelize
- Indexer-cli: Make --network argument optional if only operating on single network HOT 1
- RAV processing still executing even if user doesn't configure TAP
- use `@whatwg-node/fetch` and remove all other clients
- Migrate from `urql` to `graphql-yoga`
- Use GraphQL codegen server preset
- Migrate CLI to OClif
- Refactor CLI API calls
- Stricter linting rules to disallow `any`
- Setup commitlint
- Feat: New indexer management API for querying unclaimed query fees
- indexer-agent: Error Tx reverted "Failed to redeem RAV", but actually didn't fail HOT 1
- Bug: Seg fault starting Node processes HOT 1
- Cannot open allocate on broken subgraph
- Expose GraphiQL interface for /status endpoint
- Null value resolved for non-null field `paused` HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from indexer.