hyunsooda/klaytn-etl

Python scripts for ETL (extract, transform and load) jobs for Klaytn blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions.

Klaytn ETL

Klaytn ETL lets you convert Klaytn blockchain data into convenient formats like JSONs, CSVs and relational databases. This is a fork of Ethereum ETL.

Notice: Klaytn ETL is still on the beta version. However, CLIs are all functional.

Documents about command reference will be soon updated.

Please check issues to figure out current works.

Quickstart

Install Klaytn ETL:

pip3 install klaytn-etl-cli

Export blocks and transactions

> klaytnetl export_blocks_and_transactions --start-block 0 --end-block 5000 \
--blocks-output blocks.json --transactions-output transactions.json

Export ERC20 and ERC721 transfers

> klaytnetl export_token_transfers --start-block 0 --end-block 5000 \
--output token_transfers.json

Export traces

> klaytnetl export_traces --start-block 0 --end-block 5000 \
--output traces.json

Find other commands here.

For the latest version, check out the repo and call

> pip3 install -e . 
> python3 klaytnetl.py

Running in Docker

1. Install Docker https://docs.docker.com/install/

2. Build a docker image

   > docker build -t klaytn-etl:latest .
   > docker image ls

3. Run a container out of the image

   > docker run -v $HOME/output:/klaytn-etl/output klaytn-etl:latest export_all -s 0 -e 5499999 -b 100000
   > docker run -v $HOME/output:/klaytn-etl/output klaytn-etl:latest export_all -s 2018-01-01 -e 2018-01-01