Implement table definition files for 0x events about ethereum-etl-airflow HOT 13 CLOSED

Issue Status: 1. Open 2. Started 3. Submitted 4. Done

This issue now has a funding of 500.0 DAI (500.0 USD @ $1.0/DAI) attached to it.

• If you would like to work on this issue you can 'start work' on the Gitcoin Issue Details page.
• Want to chip in? Add your own contribution here.
• Questions? Checkout Gitcoin Help or the Gitcoin Slack
• $151,218.76 more funded OSS Work available on the Gitcoin Issue Explorer

from ethereum-etl-airflow.

Issue Status: 1. Open 2. Started 3. Submitted 4. Done

Work has been started.

These users each claimed they can complete the work by 2 weeks from now.
Please review their action plans below:

1) uivlis has started work.

I will provide you with the required table definition jsons for the events in each of the specified contracts.
2) askeluv has started work.

I'll use the DAG builder (created in a separate bounty) to create a DAG which parses 0x events (e.g. Fill and Cancel events). This will facilitate analysis of usage of the 0x protocol across their different relayers. I'll start with v2.1 of the contract, and if possible I'll add v2.0 and v1.0 as well so we get all the historical data for 0x.
3) xiitoxaiix has started work.

give me my DAI please.........

Learn more on the Gitcoin Issue Details page.

from ethereum-etl-airflow.

Wondering if we really should be adding events for WETH and ZRX in here? If the goal is to parse events relating to the 0x Protocol, I would recommend focusing on the different versions of the exchange contracts.

Specifically:

1. v1.0: 0x12459c951127e0c374ff9105dda097662a027093
2. v2.0: 0x4f833a24e1f95d70f028921e27040ca56e09ab0b
3. v2.1: 0x080bf510fcbf18b91105470639e9561022937712 (already mentioned in the issue description)

from ethereum-etl-airflow.

0xEF4229CD4495Ff7a03707BABDE503dCf8b4752c4

from ethereum-etl-airflow.

Hey @medvedev1088 I've written some table def'n files, how can I access the DAG Builder, is it the one on Google Cloud (do I have to have a billing account)?

from ethereum-etl-airflow.

@uivlis the DAG builder is a python script described here #17 that should output a DAG instance given a table definition file. You'd need an Airflow instance to test it, one option is to use Google Cloud Composer.

from ethereum-etl-airflow.

@medvedev1088 Got it. One more question, though: Can you approximate a GCP cost for running the Airflow instance for these DAGs? Would really like to know how much I would need to pay before I use the thing.

from ethereum-etl-airflow.

@uivlis it's not cheap, might cost you €250/month: https://towardsdatascience.com/airflow-by-google-a-first-impression-of-cloud-composer-f4d9f86358cf. You could also run it on your local machine though. This repository doesn't have yet instructions on how to run it locally but we have plans to add it in the future.

from ethereum-etl-airflow.

@medvedev1088 Alright, but can you give me those instructions in the meantime, or does it suffice for the scope of this bounty if I just gave you the tabled definition files?

from ethereum-etl-airflow.

Oh, I saw in the meantime that @askeluv already did that for Exchange. Maybe I should do it for the rest...

from ethereum-etl-airflow.

Issue Status: 1. Open 2. Started 3. Submitted 4. Done

Work for 500.0 DAI (500.0 USD @ $1.0/DAI) has been submitted by:

1. @uivlis
2. @askeluv

@ceresstation please take a look at the submitted work:

• PR by @askeluv
• PR by @uivlis

• Learn more on the Gitcoin Issue Details page
• Want to chip in? Add your own contribution here.
• Questions? Checkout Gitcoin Help or the Gitcoin Slack
• $146,360.80 more funded OSS Work available on the Gitcoin Issue Explorer

from ethereum-etl-airflow.

The following PR covers this issue: #20

from ethereum-etl-airflow.

Issue Status: 1. Open 2. Started 3. Submitted 4. Done

The funding of 500.0 DAI (500.0 USD @ $1.0/DAI) attached to this issue has been approved & issued to @askeluv.

• Learn more on the Gitcoin Issue Details page
• Questions? Checkout Gitcoin Help or the Gitcoin Slack
• $151,533.53 more funded OSS Work available on the Gitcoin Issue Explorer

from ethereum-etl-airflow.