vechain/thor

Failed to process block

Closed this issue · 7 comments

Hi, I encounter this error when syncing the node and currently stuck at block 9327228

Starting Thor/v1.5.0-0ecb71e-release/linux/go1.13.5
    Network      [ 0x00000000851caf3cfdb6e899cf5958bfb1ac3413d346d43539627e6be7ec1b4a mainnet ]
    Best block   [ 0x008e527c4f7b4c3ed0abf2ccd779020faea3aa7a2e400bd20dce664ec583d610 #9327228 @2021-06-15 19:11:40 +0000 UTC ]
    Forks        [ VIP191: #3337300, ETH_CONST: #3337300, BLOCKLIST: #4817300, ETH_IST: #9254300 ]
    Master       [ 0x470341205a8b41864cecc491ad2e729b72f5ce56 ]
    Beneficiary  [ not set, defaults to endorsor ]
    Instance dir [ /data/instance-39627e6be7ec1b4a-v2 ]
    API portal   [ http://[::]:8000/ ]
    Node ID      [ enode://e7932357d36d342a0a96de79d4b49283f6a2391cfbaaf7278ab6afdb4c71ca0cf800ac82621479eabfd18b74daccc0213421a0e9817bf605bec2338449b36144@[extip]:11235 ]
t=2021-06-18T05:58:51+0000 lvl=info msg="starting P2P networking"
t=2021-06-18T05:58:53+0000 lvl=info msg="waiting for synchronization..." pkg=node
t=2021-06-18T05:58:53+0000 lvl=info msg="pruner started" pkg=pruner range="[9261163, 9326857]" step=archiveIndexTrie
t=2021-06-18T05:58:53+0000 lvl=info msg="archiving index trie..." pkg=pruner
t=2021-06-18T05:58:58+0000 lvl=eror msg="failed to process block" pkg=node err="state: state: missing trie node 0xa7f2ae73d4af1e6ac485161a7c4e49229a57062efac93efdbb2cd5043543f07b (path 0f0b0b)"
t=2021-06-18T05:59:01+0000 lvl=eror msg="failed to process block" pkg=node err="state: state: missing trie node 0xa7f2ae73d4af1e6ac485161a7c4e49229a57062efac93efdbb2cd5043543f07b (path 0f0b0b)"

OS Version:

Ubuntu 16.04.4 LTS

Thor Version:

1.5.0

How much space do you have on your server? Is it running out of space?

Nope, there's still plenty of space available

// df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            7.9G     0  7.9G   0% /dev
tmpfs           1.6G  157M  1.5G  10% /run
/dev/xvda1      291G   92G  199G  32% /

the only way to solve this is to remove the data directory and re-sync again.

This is the log before the error happens:

t=2021-06-15T19:10:37+0000 lvl=info msg="imported blocks (1)" pkg=node txs=2 mgas=0.082 et=3.901ms|55.036ms mgas/s=1.387 id=[#9327222…3977dd17]
t=2021-06-15T19:10:47+0000 lvl=info msg="imported blocks (1)" pkg=node txs=1 mgas=0.021 et=892.472µs|3.407ms mgas/s=4.883 id=[#9327223…42107672]
t=2021-06-15T19:10:56+0000 lvl=info msg="imported blocks (1)" pkg=node txs=0 mgas=0.000 et=382.007µs|679.416µs mgas/s=0.000 id=[#9327224…92107f7e]
t=2021-06-15T19:11:07+0000 lvl=info msg="imported blocks (1)" pkg=node txs=18 mgas=0.437 et=30.230ms|8.309ms mgas/s=11.334 id=[#9327225…5732b457]
t=2021-06-15T19:11:16+0000 lvl=info msg="imported blocks (1)" pkg=node txs=4 mgas=0.100 et=69.236ms|24.845ms mgas/s=1.068 id=[#9327226…00c2d415]
t=2021-06-15T19:11:26+0000 lvl=info msg="imported blocks (1)" pkg=node txs=0 mgas=0.000 et=426.83µs|635.764µs mgas/s=0.000 id=[#9327227…c973d4b2]
t=2021-06-15T19:11:36+0000 lvl=info msg="imported blocks (1)" pkg=node txs=2 mgas=0.075 et=110.832ms|91.243ms mgas/s=0.370 id=[#9327228…c583d610]
t=2021-06-15T19:11:46+0000 lvl=eror msg="failed to process block" pkg=node err="state: state: missing trie node 0x4528862b34759b67104382e957c00d56b1023cf9d9b50f5b3beeb72b8045bf0f (path 030f06)"
t=2021-06-15T19:11:46+0000 lvl=eror msg="failed to process block" pkg=node err="state: state: missing trie node 0x4528862b34759b67104382e957c00d56b1023cf9d9b50f5b3beeb72b8045bf0f (path 030f06)"
t=2021-06-15T19:11:46+0000 lvl=eror msg="failed to process block" pkg=node err="state: state: missing trie node 0x4528862b34759b67104382e957c00d56b1023cf9d9b50f5b3beeb72b8045bf0f (path 030f06)"

the only way to solve this is to remove the data directory and re-sync again.

Sorry if this question is documented elsewhere, but how long would it take to sync with the network? And how many blocks would it keep if --disable-pruner is not enabled.

  1. without --disable-pruner flag it may take ~16 hours on my(6 core/64G/SSD) server.
  2. 65535 blocks

Thank you