base-org / blob-archiver Goto Github PK
View Code? Open in Web Editor NEWLicense: MIT License
License: MIT License
Unreviewed commit(s) COMPARE was merged to master by danyalprout.
Comment with appropriate number of ๐ to approve.
Reviewed requirements satisfied? No
Ancestors reviewed? Yes
Unreviewed commit(s) COMPARE was merged to master by danyalprout.
Comment with appropriate number of ๐ to approve.
Reviewed requirements satisfied? No
Ancestors reviewed? Yes
I trying to set up blob-archiver using docker-compose up and connecting it to my beacon node (with Prysm)
I am getting this error, no idea how to fix it:
archiver_1 | t=2024-03-16T13:12:54+0000 lvl=info msg="Initializing Archiver Service"
archiver_1 | {"level":"trace","service":"client","impl":"http","time":"2024-03-16T13:12:54Z","message":"Context done; closing connection"}
archiver_1 | t=2024-03-16T13:12:54+0000 lvl=info msg="starting metrics server" addr=0.0.0.0 port=7300
archiver_1 | t=2024-03-16T13:12:54+0000 lvl=info msg="started metrics server" addr=[::]:7300
archiver_1 | t=2024-03-16T13:12:54+0000 lvl=info msg="Archiver API server started" address=[::]:8000
archiver_1 | {"level":"trace","service":"client","impl":"http","id":"1de5098c","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/headers/head","time":"2024-03-16T13:12:54Z","message":"GET request"}
archiver_1 | {"level":"trace","service":"client","impl":"http","id":"3ac0b1c","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/blob_sidecars/0xb02f2ca9c5892a4e6a31bea43be747f8f1232a419c012b81d306d86e4a92c207","time":"2024-03-16T13:12:54Z","message":"GET request"}
blob-archiver_create-buckets_1 exited with code 0
archiver_1 | t=2024-03-16T13:12:54+0000 lvl=eror msg="failed to fetch blob sidecars" err="failed to decode blob sidecars: xx"
archiver_1 | {"level":"trace","service":"client","impl":"http","id":"2a5b3e44","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/headers/head","time":"2024-03-16T13:12:55Z","message":"GET request"}
archiver_1 | {"level":"trace","service":"client","impl":"http","id":"11b6f22f","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/blob_sidecars/0xb02f2ca9c5892a4e6a31bea43be747f8f1232a419c012b81d306d86e4a92c207","time":"2024-03-16T13:12:55Z","message":"GET request"}
archiver_1 | t=2024-03-16T13:12:55+0000 lvl=eror msg="failed to fetch blob sidecars" err="failed to decode blob sidecars: xx"
archiver_1 | {"level":"trace","service":"client","impl":"http","id":"4a71ead8","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/headers/head","time":"2024-03-16T13:12:58Z","message":"GET request"}
archiver_1 | {"level":"trace","service":"client","impl":"http","id":"498b6717","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/blob_sidecars/0xb02f2ca9c5892a4e6a31bea43be747f8f1232a419c012b81d306d86e4a92c207","time":"2024-03-16T13:12:58Z","message":"GET request"}
archiver_1 | t=2024-03-16T13:12:58+0000 lvl=eror msg="failed to fetch blob sidecars" err="failed to decode blob sidecars: xx"
archiver_1 | t=2024-03-16T13:12:58+0000 lvl=eror msg="failed to seed archiver with initial block" err="operation failed permanently after 3 attempts: failed to decode blob sidecars: xx"
archiver_1 | t=2024-03-16T13:12:58+0000 lvl=crit msg="Application failed" message="failed to start: operation failed permanently after 3 attempts: failed to decode blob sidecars: xx"
blob-archiver_archiver_1 exited with code 1
I've checked my beacon api endpoint, it returns the data and blob successfully. Any advise?
Ge,
Can you add a license? It would be useful in case someone wants to use this repository.
Thanks
Currently we use a different beacon client from the optimism monorepo. It would be nice to consolidate efforts in to a single library.
The blob archiver uses go-eth-2 while the optimism monorepo has its own implementation.
This is due to go-eth-2
supporting SSZ of blob types out of the box. It would be ideal to combine efforts by either:
go-eth-2
Much thanks for creating this, it's very useful in my team's setup. We are wondering about the feasibility in adding a custom endpoint to insert blobs for a given block_id.
Our setup involves running the blob-archiver off of a normal beacon node, blobs are pruned after the ~18 days. We use a custom proxy redirecting /eth/v1/beacon/blob_sidecars/{block_id}
requests to our L1 endpoint to the blob-archiver api with a fallback to an 3rd party blob archive service should it be missing a blob, consequential of upgrades, downtime etc.
Ideally we would like our blob-archiver to support an endpoint for manual insertion of blobs against a block_id(s) so that we can fill missing gaps which may occur from etherscan or some other provider which has a full blob history archive.
We understand there is a backfilling process in the archiver which we presume would collect the missing blob should we point the node at the 3rd party but this would require rebooting the process resulting in downtime we would like to avoid.
Unreviewed commit(s) COMPARE was merged to master by fahimahmedx.
Comment with appropriate number of ๐ to approve.
Reviewed requirements satisfied? No
Ancestors reviewed? Yes
Currently the API and Archiver require a trusted L1 endpoint.
We should add an option to verify the blobs (see the op-stack verification here) to both the Archiver and API.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.