bds-btc
Introduction
bds-btc is one of the independent modules in open source project of block chain data service (BDS) - provides full node service.
bds-btc Based on the v0.17.0 version of bitcoin/bitcoin,bds-btc redeveloped to support sending new block data directly to message middleware service of kafka to facilitate upstream services to subscribe and consume.
Architecture
Environmental Deployment
Install BTC
Environment Initialization
Install steps
- Compile
./autogen.sh
./configure
make
make install # optional
- Run full node and support sending messages to Kafka
/usr/local/bin/bitcoind -kafka -kafkaproxyhost=<kafka proxy host> -kafkaproxyport=<kafka proxy port，default 8082> -kafkatopic=btc -datadir=<data directory> -rpcuser=<user> -rpcpassword=<password>
Install confluent and kafka
Install kafka
See kafka
Modify config/server.properties
- message.max.bytes=1048576000
Install confluent
see confluent
Unzip the confluent package and run Confluent REST Proxy
Modify /etc/kafka-rest/kafka-rest.properties
- max.request.size = 1048576000
- buffer.memory = 1048576000
- send.buffer.bytes = 1048576000
Install BDS
See BDS
Database
Database we now support SQL Server, PostgreSQL, you can choose one as a data storage method.
SQL Server
PostgreSQL
Install Grafana
See Grafana Official
New funtion
- The new function of sending messages to Kafka is added（every time a new block is synchronized by full node, the data of the block is sent to kafka and the data structure is customized).
- Sendblock and sendbatchblock are newly added as RPC interfaces to trigger full node to send data for a specific block.