txpipe / scrolls Goto Github PK

View Code? Open in Web Editor NEW

86.0 5.0 40.0 1.88 MB

Read-optimized cache of Cardano on-chain entities

License: Apache License 2.0

Rust 98.92% Dockerfile 0.66% Shell 0.06% Nix 0.31% JavaScript 0.05%

blockchain cache cardano ouroboros

scrolls's People

Contributors

Stargazers

Watchers

scrolls's Issues

Minor: when cardano-node not available reconnection worker takes 100% CPU

So I noticed when there is an outage of cardano-node, scrolls tries to reconnect (this is great) but the small issue is that this reconnection watchdog/ daemon or worker in scrolls process is consuming way more CPU of the machine than it should.

mati@kajka:~$ sudo journalctl  -f -u scrolls
Jun 25 13:36:24 kajka scrolls[234390]: [2023-06-25T11:36:24Z WARN  gasket::retries] retryable operation error: "network error: Connection refused (os error 111)"
Jun 25 13:36:28 kajka scrolls[234390]: [2023-06-25T11:36:28Z WARN  gasket::retries] retryable operation error: "network error: Connection refused (os error 111)"
Jun 25 13:36:36 kajka scrolls[234390]: [2023-06-25T11:36:36Z WARN  gasket::retries] retryable operation error: "network error: Connection refused (os error 111)"
Jun 25 13:36:52 kajka scrolls[234390]: [2023-06-25T11:36:52Z WARN  gasket::retries] retryable operation error: "network error: Connection refused (os error 111)"
Jun 25 13:37:24 kajka scrolls[234390]: [2023-06-25T11:37:24Z WARN  gasket::retries] retryable operation error: "network error: Connection refused (os error 111)"
Jun 25 13:38:24 kajka scrolls[234390]: [2023-06-25T11:38:24Z WARN  gasket::retries] retryable operation error: "network error: Connection refused (os error 111)"
Jun 25 13:39:24 kajka scrolls[234390]: [2023-06-25T11:39:24Z WARN  gasket::retries] retryable operation error: "network error: Connection refused (os error 111)"
Jun 25 13:40:24 kajka scrolls[234390]: [2023-06-25T11:40:24Z WARN  gasket::retries] retryable operation error: "network error: Connection refused (os error 111)"
Jun 25 13:41:24 kajka scrolls[234390]: [2023-06-25T11:41:24Z WARN  gasket::retries] retryable operation error: "network error: Connection refused (os error 111)"
Jun 25 13:42:24 kajka scrolls[234390]: [2023-06-25T11:42:24Z WARN  gasket::retries] retryable operation error: "network error: Connection refused (os error 111)"

MissingTrx on sled enricher does not result in unrecoverable error and stage restarts

Is:

MissingTrx on sled enricher does not result in unrecoverable error and stage restarts

Expected behaviour:

scrolls should stop processing and perhaps even exit (-1)

UTXOs by Asset / Policy ID

Thanks again for the amazing tool and documentation !

I'm looking to build a dashboard to track wallet distribution of specific cadano native assets (ex: LQ) across multiple epochs.

Is this use-case feasible through scrolls? Glancing at the documentation, I realize "UTXOs by Asset" seems a close match (under implementation - perhaps?). Please suggest when you get a chance !

It appears as hashing PlutusScript does not lead to the same script hash.

there is a high chance that either hashing function has an issue for PlutusScript hasher:

https://github.com/txpipe/pallas/blob/main/pallas-primitives/src/alonzo/crypto.rs

there is some error in PlutusScript where exact bytes are different than Haskell implementation:

https://cardanoscan.io/address/addr1w999n67e86jn6xal07pzxtrmqynspgx0fwmcmpua4wc6yzsxpljz3

Contract Address: addr1w999n67e86jn6xal07pzxtrmqynspgx0fwmcmpua4wc6yzsxpljz3
Script Hash: 714a59ebd93ea53d1bbf7f82232c7b012700a0cf4bb78d879dabb1a20a

Error "missing utxo" using example .toml

Hi,

running scrolls with the example .toml file (cutdown slightly) on mainnet for Filter type = "UtxoByAddress" gives error:

Note: this is from compiing from scratch with redis on standard localhost and port (6379). The docker image works as expected.

ERROR gasket::runtime] STAGE: reducers, WORK, PANIC: missing utxo: ba1950d0cf9e6a551215701f85a209a9a47fb64032efa14e21fcfbf37c125a9a#0

[2022-10-16T20:45:11Z INFO  scrolls::daemon] scrolls is running...
[2022-10-16T20:45:11Z INFO  scrolls::sources::n2n::transport] handshake output: Accepted(9, VersionData { network_magic: 764824073, initiator_and_responder_diffusion_mode: true })
[2022-10-16T20:45:11Z INFO  scrolls::sources::utils] no cursor found in storage plugin
[2022-10-16T20:45:11Z INFO  scrolls::sources::n2n::transport] handshake output: Accepted(9, VersionData { network_magic: 764824073, initiator_and_responder_diffusion_mode: true })
[2022-10-16T20:45:12Z WARN  scrolls::reducers::worker] rollback requested for (57867490, c491c5006192de2c55a95fb3544f60b96bd1665accaf2dfa2ab12fc7191f016b)
[2022-10-16T20:45:13Z ERROR gasket::runtime] STAGE: reducers, WORK, PANIC: missing utxo: ba1950d0cf9e6a551215701f85a209a9a47fb64032efa14e21fcfbf37c125a9a#0
[2022-10-16T20:45:14Z INFO  scrolls::daemon] Scrolls is stopping...
[2022-10-16T20:45:14Z WARN  scrolls::daemon] dismissing stage: n2n-headers with state Alive(Working)
[2022-10-16T20:45:14Z WARN  scrolls::daemon] dismissing stage: n2n-blocks with state Alive(Working)
[2022-10-16T20:45:14Z WARN  scrolls::daemon] dismissing stage: enrich-sled with state Alive(Working)
[2022-10-16T20:45:14Z WARN  scrolls::daemon] dismissing stage: reducers with state Alive(StandBy)
[2022-10-16T20:45:14Z WARN  scrolls::daemon] dismissing stage: redis with state Alive(Working)

.toml file:

[source]
type = "N2N"
address = "relays-new.cardano-mainnet.iohk.io:3001"

[enrich]
type = "Sled"
db_path = "/blah02/sled_db"

# enable the "UTXO by Address" collection
[[reducers]]
type = "UtxoByAddress"
# you can optionally prefix the keys in the collection
key_prefix = "c1"
# you can optionally only process UTXO from a set of predetermined addresses
filter = ["addr1qy8jecz3nal788f8t2zy6vj2l9ply3trpnkn2xuvv5rgu4m7y853av2nt8wc33agu3kuakvg0kaee0tfqhgelh2eeyyqg"]

[storage]
type = "Redis"
connection_params = "redis://127.0.0.1:6379"

[intersect]
type = "Point"
value = [57867490, "c491c5006192de2c55a95fb3544f60b96bd1665accaf2dfa2ab12fc7191f016b"]

[chain]
type = "Mainnet"

I have also tried a similar .toml file on preprod testnet and get the same error. Im either doing something stupidly wrong or missing something in the setup? could anyone advise?

Scrolls server crash on preview network

Hi
I have problem with scrolls (version 0.4.3) on preview network. Scrolls is running from docker image and after processing block: 1702a60228ef0fd782d8428e8fe44297960f3355eea0b1eb1ce6e5818b2ea877 it is stopping. Below logs:

[2023-01-25T13:26:15Z INFO  scrolls::sources::n2n::transport] handshake output: Accepted(10, VersionData { network_magic: 2, initiator_and_responder_diffusion_mode: false })
[2023-01-25T13:26:15Z INFO  scrolls::sources::utils] found existing cursor in storage plugin: Specific(7995187, "1702a60228ef0fd782d8428e8fe44297960f3355eea0b1eb1ce6e5818b2ea877")
[2023-01-25T13:26:15Z INFO  scrolls::sources::n2n::chainsync] chain-sync intersection is (7995187, 1702a60228ef0fd782d8428e8fe44297960f3355eea0b1eb1ce6e5818b2ea877)
[2023-01-25T13:26:15Z INFO  scrolls::sources::n2n::chainsync] requesting next block
[2023-01-25T13:26:15Z INFO  scrolls::sources::n2n::chainsync] requesting next block
[2023-01-25T13:26:15Z WARN  scrolls::reducers::worker] rollback requested for (7995187, 1702a60228ef0fd782d8428e8fe44297960f3355eea0b1eb1ce6e5818b2ea877)
[2023-01-25T13:26:15Z INFO  scrolls::sources::n2n::chainsync] requesting next block
[2023-01-25T13:26:15Z ERROR gasket::runtime] STAGE: reducers, WORK, PANIC: cbor error: Invalid CBOR structure: unexpected type indefinite bytes at position 1831: expected bytes (definite length)
[2023-01-25T13:26:15Z INFO  scrolls::sources::n2n::chainsync] requesting next block
[2023-01-25T13:26:15Z INFO  scrolls::sources::n2n::chainsync] requesting next block
...
[2023-01-25T13:26:15Z INFO  scrolls::sources::n2n::chainsync] chain-sync reached the tip of the chain
[2023-01-25T13:26:15Z INFO  scrolls::sources::n2n::chainsync] awaiting next block (blocking)
[2023-01-25T13:26:16Z INFO  scrolls::daemon] Scrolls is stopping...
[2023-01-25T13:26:16Z WARN  scrolls::daemon] dismissing stage: n2n with state Alive(Working)
[2023-01-25T13:26:16Z WARN  scrolls::daemon] dismissing stage: enrich-skip with state Alive(Working)
[2023-01-25T13:26:16Z WARN  scrolls::daemon] dismissing stage: reducers with state Alive(StandBy)
[2023-01-25T13:26:16Z WARN  scrolls::daemon] dismissing stage: redis with state Alive(Working)

Add support deno as a reducer

Feat: Address by Ada Handle

I saw Oura had a feature being worked on in April to show Ada handle address mappings. Is this still on the priority list to potentially be added to scrolls soon?

FR: reducer - implement txcbor by txhash [Eternl]

Marcel from Ethernl wallet would like to start slowly shifting to scrolls for some queries, one query he wants to experiment first is getting transaction body CBOR based on transaction hash.

Question about utxo_by_address filtering

Hello,

As per the documentation, there is a todo "Document filtering options per collection".

I had a look at the code and from what I understood, it doesn't seem like address filtering is already implemented for that Reducer.

The relevant steps I identified where it could have been implemented are when:

The block is reduced into the different TXs (reduce_byron/alonzo_tx).
Each TX is transformed into CRDT (send_set_add) and sent for the storage step.

I saw nothing like an address filtering in that part of the code. The questions are then:

=> Is it implemented and I'm not looking at it the right way OR it is not implemented yet and you already have an idea of how it could be?

New reducer not detected at execution

feat: allow splitting scrolls into multiple instances

In order to run scrolls in production, it is necessary to be able to run multiple sled instances on the same sled database.

Dependencies:

Allow to configure redis _cursor name via config
Separate sled write away from the scrolls. We should have a command line tool that keeps scrolls ingestion process separate from scrolls instance. Scrolls instance should use sled db and only in case reducers are configured that need it

bug: potential for inaccurate data due to missing some blocks when using N2N

There is currently an issue which means some blocks (random) are not processed when using N2N, meaning the accuracy of data cannot be guaranteed. When attempting to roll forward to a new block header while following the tip, the server may sometimes respond to the BlockFetch message with a MsgNoBlocks instead of the requested block data, but Scrolls does not handle this case and behaves as if it processed the block. This means that any actions that would have occurred due to the missed blocks will not be reflected in the data in Scrolls.

Scrolls does not resume when relay goes offline and back online

What I expect is that when relay goes offline and then back offline scrolls continues operation. Instead I see error messages and processing stops:

Aug 06 11:25:58 kajka systemd-journald[259]: Suppressed 748117 messages from scrolls.service
Aug 06 11:26:28 kajka systemd-journald[259]: Suppressed 753118 messages from scrolls.service
Aug 06 11:26:58 kajka systemd-journald[259]: Suppressed 742835 messages from scrolls.service
Aug 06 11:27:28 kajka systemd-journald[259]: Suppressed 746538 messages from scrolls.service
Aug 06 11:27:58 kajka systemd-journald[259]: Suppressed 747329 messages from scrolls.service
Aug 06 11:28:28 kajka systemd-journald[259]: Suppressed 749589 messages from scrolls.service
Aug 06 11:28:58 kajka systemd-journald[259]: Suppressed 749292 messages from scrolls.service
Aug 06 11:29:28 kajka systemd-journald[259]: Suppressed 736017 messages from scrolls.service

Aug 06 11:53:59 kajka scrolls[38140]: [2022-08-06T09:53:59Z ERROR gasket::runtime] error that requires stage to restart: channel error communicating with multiplexer: channel is not connected, failed to send payload
Aug 06 11:53:59 kajka scrolls[38140]: [2022-08-06T09:53:59Z ERROR gasket::runtime] error that requires stage to restart: channel error communicating with multiplexer: channel is not connected, failed to send payload
Aug 06 11:53:59 kajka scrolls[38140]: [2022-08-06T09:53:59Z ERROR gasket::runtime] error that requires stage to restart: channel error communicating with multiplexer: channel is not connected, failed to send payload
Aug 06 11:53:59 kajka scrolls[38140]: [2022-08-06T09:53:59Z ERROR gasket::runtime] error that requires stage to restart: channel error communicating with multiplexer: channel is not connected, failed to send payload
Aug 06 11:53:59 kajka scrolls[38140]: [2022-08-06T09:53:59Z ERROR gasket::runtime] error that requires stage to restart: channel error communicating with multiplexer: channel is not connected, failed to send payload
Aug 06 11:53:59 kajka scrolls[38140]: [2022-08-06T09:53:59Z ERROR gasket::runtime] error that requires stage to restart: channel error communicating with multiplexer: channel is not connected, failed to send payload
Aug 06 11:53:59 kajka scrolls[38140]: [2022-08-06T09:53:59Z ERROR gasket::runtime] error that requires stage to restart: channel error communicating with multiplexer: channel is not connected, failed to send payload
Aug 06 11:53:59 kajka scrolls[38140]: [2022-08-06T09:53:59Z ERROR gasket::runtime] error that requires stage to restart: channel error communicating with multiplexer: channel is not connected, failed to send payload
Aug 06 11:53:59 kajka scrolls[38140]: [2022-08-06T09:53:59Z ERROR gasket::runtime] error that requires stage to restart: channel error communicating with multiplexer: channel is not connected, failed to send payload

scrolls is now stuck on cursor:

127.0.0.1:16379> get _cursor
"52640848,aa9c017c2e5830a710f907aa4ee4bb071e19208cec5941074192b8993202339c"
127.0.0.1:16379> get _cursor
"52640848,aa9c017c2e5830a710f907aa4ee4bb071e19208cec5941074192b8993202339c"
127.0.0.1:16379> get _cursor
"52640848,aa9c017c2e5830a710f907aa4ee4bb071e19208cec5941074192b8993202339c"

and does not proceed

[FR] reducers::transaction_count_by_contract_address

Here is an example for a contract jpg.store:

https://cardanoscan.io/address/addr1w999n67e86jn6xal07pzxtrmqynspgx0fwmcmpua4wc6yzsxpljz3

It would be nice to have a reducer where we can get the Transaction Count across all epochs for a given contract address, e.g.

addr1w999n67e86jn6xal07pzxtrmqynspgx0fwmcmpua4wc6yzsxpljz3 -> 3185960

ERROR gasket::runtime] STAGE: reducers, WORK, PANIC: variable-length uint error: variable-length uint overflow

STAGE: reducers, WORK, PANIC: variable-length uint error: variable-length uint overflow
Scrolls is stopping...

This happens while running in docker
any idea what is happening?

`[2022-09-02T05:01:16Z INFO scrolls::storage::redis] new cursor saved to redis 65011840,d4a00c3ba23a44705fb69a22d0feeec7b47481cb9f92510bda6909faaf37772e

[2022-09-02T05:01:17Z INFO scrolls::storage::redis] new cursor saved to redis 65011944,f999af602ab467b8d8bd71662138aeec1578659f37c51dd555728b04d4093d07

[2022-09-02T05:01:17Z ERROR gasket::runtime] STAGE: reducers, WORK, PANIC: variable-length uint error: variable-length uint overflow

[2022-09-02T05:01:17Z INFO scrolls::daemon] Scrolls is stopping...

[2022-09-02T05:01:17Z WARN scrolls::daemon] dismissing stage: n2n-headers with state Alive(Working)

[2022-09-02T05:01:17Z WARN scrolls::daemon] dismissing stage: n2n-blocks with state Alive(Working)

[2022-09-02T05:01:17Z WARN scrolls::daemon] dismissing stage: enrich-skip with state Alive(Working)

[2022-09-02T05:01:17Z WARN scrolls::daemon] dismissing stage: reducers with state Alive(StandBy)

[2022-09-02T05:01:17Z WARN scrolls::daemon] dismissing stage: redis with state Alive(Working)

[2022-09-02T05:01:17Z ERROR gasket::runtime] STAGE: redis, WORK, RECV ERR: error receiving work unit through input port

[2022-09-02T05:01:17Z ERROR gasket::runtime] STAGE: enrich-skip, WORK, SEND ERR: error sending work unit through output port

[2022-09-02T05:01:17Z WARN gasket::runtime] STAGE: n2n-blocks, WORK, RESTART: downstream error while processing business logic error sending work unit through output port

[2022-09-02T05:01:17Z WARN gasket::runtime] STAGE: n2n-headers, WORK, RESTART: downstream error while processing business logic error sending work unit through output port

[2022-09-07T17:46:42Z INFO scrolls::daemon] scrolls is running...

[2022-09-07T17:46:42Z INFO scrolls::sources::n2n::transport] handshake output: Accepted(7, VersionData { network_magic: 764824073, initiator_and_responder_diffusion_mode: false })

[2022-09-07T17:46:42Z INFO scrolls::sources::utils] found existing cursor in storage plugin: Specific(65011944, "f999af602ab467b8d8bd71662138aeec1578659f37c51dd555728b04d4093d07")

[2022-09-07T17:46:42Z WARN scrolls::reducers::worker] rollback requested for (65011944, f999af602ab467b8d8bd71662138aeec1578659f37c51dd555728b04d4093d07)

[2022-09-07T17:46:42Z ERROR gasket::runtime] STAGE: reducers, WORK, PANIC: variable-length uint error: variable-length uint overflow

[2022-09-07T17:46:43Z INFO scrolls::daemon] Scrolls is stopping...

[2022-09-07T17:46:43Z WARN scrolls::daemon] dismissing stage: n2n-headers with state Alive(Working)

[2022-09-07T17:46:43Z WARN scrolls::daemon] dismissing stage: n2n-blocks with state Alive(Working)

[2022-09-07T17:46:43Z WARN scrolls::daemon] dismissing stage: enrich-skip with state Alive(Working)

[2022-09-07T17:46:43Z WARN scrolls::daemon] dismissing stage: reducers with state Alive(StandBy)

[2022-09-07T17:46:43Z WARN scrolls::daemon] dismissing stage: redis with state Alive(Working)

[2022-09-07T17:46:43Z ERROR gasket::runtime] STAGE: redis, WORK, RECV ERR: error receiving work unit through input port

[2022-09-07T17:46:43Z ERROR gasket::runtime] STAGE: enrich-skip, WORK, SEND ERR: error sending work unit through output port

[2022-09-07T17:46:43Z WARN gasket::runtime] STAGE: n2n-blocks, WORK, RESTART: downstream error while processing business logic error sending work unit through output port

[2022-09-07T17:46:43Z WARN gasket::runtime] STAGE: n2n-headers, WORK, RESTART: downstream error while processing business logic error sending work unit through output port`

refactor: update gasket and pallas

Panic on reducer: Is AlonzoCompatible a MultiAsset era?

The following reducers doesn't work.

use serde::Deserialize;

use pallas::ledger::traverse::{Feature, MultiEraBlock};

use crate::model;

#[derive(Deserialize)]
pub struct Config {
pub key_prefix: Option,
}

pub struct Reducer {
config: Config
}

impl Reducer {

    pub fn reduce_block(
        &mut self,
        block: &MultiEraBlock,
        output: &mut super::OutputPort,
    ) -> Result<(), gasket::error::Error> {
        if block.era().has_feature(Feature::MultiAssets) {
            for tx in block.txs() {
                let mint = tx.mint();

                let mints = mint.as_alonzo().unwrap();

                for (policy, assets) in mints.iter() {
                    let policy_id = hex::encode(policy.as_slice());

                    let number_of_minted_or_destroyed = assets.len();

                    let key = match &self.config.key_prefix {
                        Some(prefix) => format!("{}.{}", prefix, policy_id),
                        None => format!("{}.{}", "transaction_count_by_native_token_policy".to_string(), policy_id),
                    };

                    let crdt = model::CRDTCommand::PNCounter(key, number_of_minted_or_destroyed as i64);
                    output.send(gasket::messaging::Message::from(crdt))?;
                };
            }
        }

        Ok(())
    }
}

impl Config {
    pub fn plugin(self) -> super::Reducer {
        let reducer = Reducer {
            config: self
        };

        super::Reducer::TransactionsCountByNativeTokenPolicyId(reducer)
    }
}

it dies at block:

127.0.0.1:6379> get _cursor
"23068793,69c44ac1dda2ec74646e4223bc804d9126f719b1c245dadc2ad65e8de1b276d7"

expected behavior is that it does not crash and proceeds further

Setup mdBook documentation placeholder

Oura project uses mdBook to hold its documentation. We need to implement the same thing for Scrolls.

The goal of this issue is to setup mdBook in this repository as a placeholder for documentation that still needs to be written:

copy the github action workflow from Oura
initialize the requied mdBook folder / files
copy the basic info from the README into the introduction of the mdBook

Writing the actual documentation is out of scope

scrolls CLI ignores --config flag

I am trying to run scrolls without docker compose. But the CLI ignores the config file passed through --config flag and throws error.

Steps to reproduce:

Create a daemon.toml file with required entries
Run the following command

./scrolls daemon --config daemon.toml

Error:

ERROR: ConfigError(
"missing field source",
)

bug: `TxCountByAddress` reducer incrementing multiple times per tx

TxCountByAddress seems to be a naive copy of BalanceByAddress and increments the txcounter per txin and txout in the transaction which matches the address, when it should probably just increment the counter once per tx where at least one txin or txout matches the address. Also, the default prefix reads balance_by_address.

I'll fix.

Use specific metrics/counters for the reducers

Ideally, we should promote metrics / counters rather than logs for these high-frequency observations (as when data as been added to the Storage). Might be a nice addition for a follow up (from the utxo_by_address filter PR).

Originally posted by @scarmuega in #18 (comment)

[FR] Reducers::tvl_by_contract_address_and_epoch

Here is an example of TVL for a contract jpg.store:

https://cardanoscan.io/address/addr1w999n67e86jn6xal07pzxtrmqynspgx0fwmcmpua4wc6yzsxpljz3

It would be nice to have a reducer where we can get the data about TVL (total value locked) across a specific epoch, e.g.

addr1w999n67e86jn6xal07pzxtrmqynspgx0fwmcmpua4wc6yzsxpljz3.339 -> 445562 * 1000000 (lovelaces value)

[FR] reducers::transaction_count_by_contract_address_and_epoch

Here is an example for a contract jpg.store:

https://cardanoscan.io/address/addr1w999n67e86jn6xal07pzxtrmqynspgx0fwmcmpua4wc6yzsxpljz3
It would be nice to have a reducer where we can get the Transaction Count across a specific epoch for a given contract address, e.g.

addr1w999n67e86jn6xal07pzxtrmqynspgx0fwmcmpua4wc6yzsxpljz3.339 -> 3185960

Sled integration is not working correctly (fails silently)

I tried to ingest data using enricher from the Origin a few times and each time after ca 4,7 GB - 5 GB sled breaks, ingestion continues but sled is simply dead and no new transaction data is being written.

Expectations:

Increase log level, seems sled exceptions maybe swallowed
if sled ingestion breaks for whatever reason processing should be halted, otherwise it gives a false assumption that everything is fine and data is stored while in fact it isn't

Error when connecting to preview cardano node

Hi.
When Im trying to sync with local cardano node for preview network I get following error:

scrolls_1                 | [2022-12-01T14:20:27Z INFO  scrolls::sources::n2n::transport] handshake output: Accepted(10, VersionData { network_magic: 2, initiator_and_responder_diffusion_mode: false })
scrolls_1                 | [2022-12-01T14:20:27Z INFO  scrolls::sources::n2n::transport] handshake output: Accepted(10, VersionData { network_magic: 2, initiator_and_responder_diffusion_mode: false })
scrolls_1                 | [2022-12-01T14:20:27Z INFO  scrolls::sources::utils] found existing cursor in storage plugin: Specific(1363359, "33f1f63f10e82cf72e137b92e6d307be85e8a3ddd5b9131220734b82cd2974ae")
scrolls_1                 | [2022-12-01T14:20:27Z WARN  scrolls::reducers::worker] rollback requested for (1363359, 33f1f63f10e82cf72e137b92e6d307be85e8a3ddd5b9131220734b82cd2974ae)
scrolls_1                 | [2022-12-01T14:20:27Z ERROR gasket::runtime] STAGE: reducers, WORK, PANIC: cbor error: Invalid CBOR structure: decode error: bad cbor data type for plutus data
scrolls_1                 | [2022-12-01T14:20:28Z INFO  scrolls::daemon] Scrolls is stopping...

It seems to be realed to https://discordapp.com/channels/826816523368005654/892793958097375282/1041704392778317875 as we had problems with other components as well

[FR] Reducers::tvl_by_contract_address

Here is an example of TVL for a contract jpg.store:

https://cardanoscan.io/address/addr1w999n67e86jn6xal07pzxtrmqynspgx0fwmcmpua4wc6yzsxpljz3

It would be nice to have a reducer where we can get the data about TVL (total value locked) across all epochs.

addr1w999n67e86jn6xal07pzxtrmqynspgx0fwmcmpua4wc6yzsxpljz3 -> 445562 * 1000000 (lovelaces value)

Help with example of working config for "Address by Ada Handle" reducer

Could anyone help me testing this config in preprod environment? Or maybe provide an example of a working one?

[source]
type = "N2N"
address = "preprod-node.world.dev.cardano.org:30000"

[[reducers]]
type = "AddressByAdaHandle"
key_prefix = "AddressByAdaHandle"
policy_id_hex = "f0ff48bbb7bbe9d59a40f1ce90e9e9d0ff5002ec48f232b49ca0fb9a"

[storage]
type = "Redis"
connection_params = "redis://127.0.0.1:6379/2"

[chain]
type = "PreProd"

[intersect]
type = "Point"
value = [8261225,"103ff3cfec6e388db803fc10dbdecb3026b4a51382008d01ff3f9121be6fa6e4"]

After minting this handle $myhandle:

I was expecting to see it under the key AddressByAdaHandle.$myhandle, in my redis logical db 2, but nothing shows up:

[2] > keys *
1) "_cursor"

I am using the binary from asset_holders_by_asset_id branch which already has the reducer implemented. FYI, I've built it with cargo build --release --locked --all-features && strip ./target/release/scrolls || true and I am calling like this: /usr/local/bin/scrolls daemon --config /path/to/config.toml. I also do del _cursor on redis before each test.

oura command to help debugging:

oura watch --since 8261225,103ff3cfec6e388db803fc10dbdecb3026b4a51382008d01ff3f9121be6fa6e4 preprod-node.world.dev.cardano.org:30000 --bearer tcp --magic preprod`

Thanks for looking! 💐

txpipe / scrolls Goto Github PK

scrolls's People

Contributors

Stargazers

Watchers

Forkers

scrolls's Issues

Recommend Projects

Recommend Topics

Recommend Org