Polkastats backend v2

Polkadot Kusama network statistics backend

This repository is ARCHIVED, for latest version go to https://github.com/polkastats/polkastats

Polkadot Kusama full node

You will need a kusama full node listening at localhost:9944. You can setup one following this guide: https://blog.colmenalabs.org/running-polkadot-kusama/

Build backend (run as root)

# Change dir
$ cd /usr/local

# Clone this repo
$ git clone https://github.com/Colm3na/polkastats-backend-v2.git

# Change dir
$ cd polkastats-backend-v2

# Install dependencies
$ npm install

# Serve with nodejs
$ node index.js

# Or start with forever (recommended)
$ forever start /usr/local/polkastats-backend-v2/index.js

Setup backend as systemd service:

Create file /etc/systemd/system/polkastats.service:

nano /etc/systemd/system/polkastats.service

File contents:

[Unit]
Description=PolkaStats v2 backend

[Service]
ExecStart=/usr/bin/node /usr/local/polkastats-backend-v2/index.js
Restart=always
# Restart service after 10 seconds if node service crashes
RestartSec=10
# Output to syslog
StandardOutput=syslog
StandardError=syslog
SyslogIdentifier=polkastats-backend
#User=<alternate user>
#Group=<alternate group>
Environment=NODE_ENV=production

[Install]
WantedBy=multi-user.target

Enable backend service:

systemctl enable polkastats

Start backend:

systemctl start polkastats

Backend status:

systemctl status polkastats

Output:

● polkastats.service - PolkaStats v2 backend
   Loaded: loaded (/etc/systemd/system/polkastats.service; enabled; vendor preset: enabled)
   Active: active (running) since Sun 2019-10-27 12:06:17 CET; 5s ago
 Main PID: 10467 (node)
    Tasks: 7 (limit: 4915)
   CGroup: /system.slice/polkastats.service
           └─10467 /usr/bin/node /usr/local/polkastats-backend-v2/index.js

oct 27 12:06:17 vps714213 systemd[1]: Started PolkaStats v2 backend.
oct 27 12:06:18 vps714213 polkastats-backend[10467]: PolkaStats v2 Backend HTTPS RPC running on port 8443

Setup backend MySQL database

Create database, user, permissions and tables:

$ echo sql/polkastats.sql | mysql -u root -p'your_mysql_root_password'

Run crawlers via cron

Add this to your /etc/crontab file:

## PolkaStats backend v2 crawlers
* *  * * *   root     node /usr/local/polkastats-backend-v2/crawlers/intention.js 2>&1 >/dev/null
* *  * * *   root     node /usr/local/polkastats-backend-v2/crawlers/validator.js 2>&1 >/dev/null

# Execute chain.js crawler every 10s
* *  * * *   root     node /usr/local/polkastats-backend-v2/crawlers/chain.js 2>&1 >/dev/null
* *  * * *   root     sleep 10 && node /usr/local/polkastats-backend-v2/crawlers/chain.js 2>&1 >/dev/null
* *  * * *   root     sleep 20 && node /usr/local/polkastats-backend-v2/crawlers/chain.js 2>&1 >/dev/null
* *  * * *   root     sleep 30 && node /usr/local/polkastats-backend-v2/crawlers/chain.js 2>&1 >/dev/null
* *  * * *   root     sleep 40 && node /usr/local/polkastats-backend-v2/crawlers/chain.js 2>&1 >/dev/null
* *  * * *   root     sleep 50 && node /usr/local/polkastats-backend-v2/crawlers/chain.js 2>&1 >/dev/null

# Execute every 1m
*/1 *  * * *   root     node /usr/local/polkastats-backend-v2/crawlers/phragmen.js 2>&1 >/dev/null

# Execute every 5m
*/5 *  * * *   root     node /usr/local/polkastats-backend-v2/crawlers/intention_bonded.js 2>&1 >/dev/null
*/5 *  * * *   root     node /usr/local/polkastats-backend-v2/crawlers/validator_bonded.js 2>&1 >/dev/null
*/5 *  * * *   root     /usr/local/polkastats-backend-v2/nicknames.sh 2>&1 >/dev/null
*/5 *  * * *   root     node /usr/local/polkastats-backend-v2/crawlers/account.js 2>&1 >/dev/null

# Execute every 10m
*/10 *  * * *   root     node /usr/local/polkastats-backend-v2/crawlers/keybase_identity.js 2>&1 >/dev/null

# Execute every hour
0 *  * * *   root     node /usr/local/polkastats-backend-v2/crawlers/system.js 2>&1 >/dev/null