Blockchain ETL
Facilitating data science on blockchain data. Available in Google BigQuery https://goo.gl/oY5BCQ
Pinned Repositories
awesome-bigquery-views
Useful SQL queries for Blockchain ETL datasets in BigQuery.
awesome-etl-tools
Awesome ETL tools for blockchain data
bitcoin-etl
ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
blockchain-etl-streaming
Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes
ethereum-etl
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
ethereum-etl-airflow
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee
ethereum-etl-postgres
ETL for moving Ethereum data to PostgreSQL database
ethereum2-etl
Python scripts for ETL (extract, transform and load) jobs for Ethereum 2.0 beacon blocks, attestations, deposits, slashings, validators, committees. Data is available in Google BigQuery
polygon-etl
ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub
public-datasets
The list of public blockchain datasets in BigQuery
Blockchain ETL's Repositories
blockchain-etl/ethereum-etl
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
blockchain-etl/bitcoin-etl
ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
blockchain-etl/ethereum-etl-airflow
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee
blockchain-etl/public-datasets
The list of public blockchain datasets in BigQuery
blockchain-etl/ethereum-etl-postgres
ETL for moving Ethereum data to PostgreSQL database
blockchain-etl/polygon-etl
ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub
blockchain-etl/ethereum2-etl
Python scripts for ETL (extract, transform and load) jobs for Ethereum 2.0 beacon blocks, attestations, deposits, slashings, validators, committees. Data is available in Google BigQuery
blockchain-etl/ethers.js-bigquery
ethers.js library, compiled for use in Google BigQuery
blockchain-etl/solana-etl-airflow
ETL for Solana. Contributions are welcome. Join the Telegram channel https://t.me/joinchat/GsMpbA3mv1OJ6YMp3T5ORQ
blockchain-etl/tezos-etl
Python scripts for ETL (extract, transform and load) jobs for Tezos blocks, balance updates, and operations
blockchain-etl/hedera-etl
ETL scripts for Hedera Hashgraph
blockchain-etl/solana-etl
blockchain-etl/eos-etl
ETL scripts for EOS.
blockchain-etl/abi-functions
blockchain-etl/awesome-etl-tools
Awesome ETL tools for blockchain data
blockchain-etl/blockchain-etl-dataflow
Dataflow pipelines for Blockchain ETL. Connects Pub/Sub topics with BigQuery tables.
blockchain-etl/abi-parser
Web app which parses smart contracts and outputs queries and tables for Ethereum-ETL
blockchain-etl/blockchain-terraform-deployment
Template repository for deploying https://github.com/blockchain-etl/blockchain-terraform
blockchain-etl/etl-rust
blockchain-etl/abi
EVM public good - pull requests welcome for any ABI from any EVM
blockchain-etl/band-etl
ETL (extract, transform and load) tools for ingesting Band Protocol blockchain data to Google BigQuery and Pub/Sub
blockchain-etl/blockchain-etl-common
Common utils for blockchain-etl
blockchain-etl/iotex-etl
ETL (extract, transform and load) tools for ingesting IoTeX blockchain data to Google BigQuery and Pub/Sub
blockchain-etl/ordinals-etl
blockchain-etl/docker-bitcoind
💰 Bitcoind Docker image that runs the Bitcoin node in a container for easy deployment
blockchain-etl/twitter-bot-cloud-function
Google Cloud Function for tweeting Blockchain ETL alerts
blockchain-etl/zilliqa-etl
Python scripts for ETL (extract, transform and load) jobs for Zilliqa blockchain data
blockchain-etl/tezos-etl-airflow
Airflow DAGs for exporting and loading the Tezos blockchain data to Google BigQuery
blockchain-etl/throttle-pubsub-cloud-function
Google Cloud Function that can throttle messages in a Pub/Sub topic
blockchain-etl/pubsub-to-firestore-cloud-function
Google Cloud Function that pulls messages from Pub/Sub and saves them in Firestore