vitelabs/go-vite

gvite can not start properly

Opened this issue · 3 comments

Please make sure you have search your question in our forum.

Describe the bug briefly

gvite can not start properly

Information

after I kill the previous gvite to do some ops for my os, when restart the gvite, it can not start properly, and OS report OOM. It is normal before kill, and gvite process is OK in my another same hardware os server。So there maybe some logic not process properly in gvite start, mainly cause the process using too much memory

  • OS
    [root@VM_0_7_centos gvite-v2.9.0-linux]# uname -r
    3.10.0-1062.9.1.el7.x86_64
    [root@VM_0_7_centos gvite-v2.9.0-linux]# cat /etc/redhat-release
    CentOS Linux release 7.6.1810 (Core)

  • Hardware (CPU info and Memory size)
    Architecture: x86_64
    CPU op-mode(s): 32-bit, 64-bit
    Byte Order: Little Endian
    CPU(s): 1
    On-line CPU(s) list: 0
    Thread(s) per core: 1
    Core(s) per socket: 1
    Socket(s): 1
    NUMA node(s): 1
    Vendor ID: GenuineIntel
    CPU family: 6
    Model: 79
    Model name: Intel(R) Xeon(R) CPU E5-26xx v4
    Stepping: 1
    CPU MHz: 2394.454
    BogoMIPS: 4788.90
    Hypervisor vendor: KVM
    Virtualization type: full
    L1d cache: 32K
    L1i cache: 32K
    L2 cache: 4096K
    NUMA node0 CPU(s): 0
    Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc rep_good nopl eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch bmi1 avx2 bmi2 rdseed adx xsaveopt

[root@VM_0_7_centos gvite-v2.9.0-linux]# free
total used free shared buff/cache available
Mem: 1882192 524988 730196 504 627008 1199168
Swap: 0 0 0

  • gvite version
    [root@VM_0_7_centos gvite-v2.9.0-linux]# ./gvite --version
    this vite node`s git GO version is b0ae1db
    gvite version v2.9.0

  • peer` number, can get from this API

  • Startup log, is in file gvite.log, usually in the same directory which gvite belongs.

    Command grep -i "error" gvite.log can find the startup error. If the output is not null, then paste it into this issue.

  • Runtime log, runtime log directory will be printed into gvite.log when gvite start.

    [root@VM_0_7_centos gvite-v2.9.0-linux]# tail -n 100 gvite.log
    this vite node`s git GO version is b0ae1db
    t=2020-07-28T23:27:43.006+0800 lvl=info msg="runtime num" module=gvite/main max=2
    t=2020-07-28T23:27:43.006+0800 lvl=info msg="DefaultNodeconfig: { /root/.gvite /root/.gvite 0 [] false 0.0.0.0 8483 8484 vite-node 3 true 60 5 2 10 [] [] [] any [] [] [] [] cross false 0 false false false gvite.ipc 48132 [] 31420 [] [] [] true true info false false false false false }" module=gvite/node_manager
    t=2020-07-28T23:27:43.006+0800 lvl=info msg="Will use the default config node_config.json" module=gvite/node_manager
    t=2020-07-28T23:27:43.006+0800 lvl=info msg="After load config file: { /root/.gvite /root/.gvite 0 [] 0xc00003077c false 0.0.0.0 8483 8484 newcent_001 1 true 10 5 2 5 [] [https://bootnodes.vite.net/bootmainnet.json] [] any [] [] [] [] cross false 0 true true false gvite.ipc 0.0.0.0 48132 [] 0.0.0.0 41420 [] [] [ledger public_onroad net contract pledge register vote mintage consensusGroup tx debug sbpstats dashboard] true true dbug false false false false false wss://stats.vite.net vite_24d6313a1ee1bcd8e979565a39a9c6f4decc8a1be01a5debee }" module=gvite/node_manager
    t=2020-07-28T23:27:43.006+0800 lvl=info msg="After mapping cmd input: { /root/.gvite /root/.gvite 0 [] 0xc00003077c false 0.0.0.0 8483 8484 newcent_001 1 true 10 5 2 5 [] [https://bootnodes.vite.net/bootmainnet.json] [] any [] [] [] [] cross false 0 true true false gvite.ipc 0.0.0.0 48132 [] 0.0.0.0 41420 [] [] [ledger public_onroad net contract pledge register vote mintage consensusGroup tx debug sbpstats dashboard] true true dbug false false false false false wss://stats.vite.net vite_24d6313a1ee1bcd8e979565a39a9c6f4decc8a1be01a5debee 0xc0003e93f0 0xc0003e9400 0xc0003e9410 0xc0003e9420}" module=gvite/node_manager
    t=2020-07-28T23:27:43.006+0800 lvl=info msg="Last override config: {main /root/.gvite/maindata /root/.gvite/maindata/wallet 0 [] 0xc00003077c false 0.0.0.0 8483 8484 newcent_001 1 true 10 5 2 5 [] [https://bootnodes.vite.net/bootmainnet.json] [] any [] [] [] [] cross false 0 true true false gvite.ipc 0.0.0.0 48132 [] 0.0.0.0 41420 [] [] [ledger public_onroad net contract pledge register vote mintage consensusGroup tx debug sbpstats dashboard] true true dbug false false false false false wss://stats.vite.net vite_24d6313a1ee1bcd8e979565a39a9c6f4decc8a1be01a5debee 0xc0003e93f0 0xc0003e9400 0xc0003e9410 0xc0003e9420}" module=gvite/node_manager
    t=2020-07-28T23:27:43.006+0800 lvl=info msg=NodeServer.DataDir:/root/.gvite/maindata module=gvite/node_manager
    t=2020-07-28T23:27:43.006+0800 lvl=info msg=NodeServer.KeyStoreDir:/root/.gvite/maindata/wallet module=gvite/node_manager
    Node prepared successfully!!!
    Node started successfully!!!
    Vite RPC service started successfully!
    no more log info output

strace message:

clock_gettime(CLOCK_MONOTONIC, {1342, 256468338}) = 0
clock_gettime(CLOCK_MONOTONIC, {1342, 256494631}) = 0
futex(0x1cb4020, FUTEX_WAIT_PRIVATE, 0, {0, 9911020}) = -1 ETIMEDOUT (Connection timed out)
clock_gettime(CLOCK_MONOTONIC, {1342, 266592360}) = 0
futex(0x1cb00d0, FUTEX_WAKE_PRIVATE, 1) = 1
clock_gettime(CLOCK_MONOTONIC, {1342, 266723297}) = 0
futex(0xc0001fcf40, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0xc000052f40, FUTEX_WAKE_PRIVATE, 1) = 1
clock_gettime(CLOCK_MONOTONIC, {1342, 266869776}) = 0
clock_gettime(CLOCK_MONOTONIC, {1342, 266894495}) = 0
futex(0x1cb4020, FUTEX_WAIT_PRIVATE, 0, {0, 9916757}) = -1 ETIMEDOUT (Connection timed out)
clock_gettime(CLOCK_MONOTONIC, {1342, 277174761}) = 0
futex(0x1cb00d0, FUTEX_WAKE_PRIVATE, 1) = 1
clock_gettime(CLOCK_MONOTONIC, {1342, 277311144}) = 0
futex(0xc0001fcf40, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0xc000052f40, FUTEX_WAKE_PRIVATE, 1) = 1
clock_gettime(CLOCK_MONOTONIC, {1342, 277483774}) = 0
futex(0x1cb4020, FUTEX_WAIT_PRIVATE, 0, {0, 255358245}) = 0
clock_gettime(CLOCK_MONOTONIC, {1342, 287600295}) = 0
clock_gettime(CLOCK_MONOTONIC, {1342, 287746114}) = 0
futex(0x1cb4020, FUTEX_WAIT_PRIVATE, 0, {0, 9905231}) = -1 ETIMEDOUT (Connection timed out)
clock_gettime(CLOCK_MONOTONIC, {1342, 297836297}) = 0
futex(0x1cb00d0, FUTEX_WAKE_PRIVATE, 1) = 1
clock_gettime(CLOCK_MONOTONIC, {1342, 298033465}) = 0
futex(0xc0001fcf40, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0xc000052f40, FUTEX_WAKE_PRIVATE, 1) = 1
clock_gettime(CLOCK_MONOTONIC, {1342, 298203509}) = 0
futex(0x1cb4020, FUTEX_WAIT_PRIVATE, 0, {0, 234635924}) = 0
futex(0x1cb00d0, FUTEX_WAKE_PRIVATE, 1) = 1
clock_gettime(CLOCK_MONOTONIC, {1342, 318508297}) = 0
clock_gettime(CLOCK_MONOTONIC, {1342, 318684763}) = 0
futex(0x1cb4020, FUTEX_WAIT_PRIVATE, 0, {0, 9826970}) = -1 ETIMEDOUT (Connection timed out)
clock_gettime(CLOCK_MONOTONIC, {1342, 328664161}) = 0
futex(0x1cb00d0, FUTEX_WAKE_PRIVATE, 1) = 1
clock_gettime(CLOCK_MONOTONIC, {1342, 328721322}) = 0
futex(0xc0001fcf40, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0xc000052f40, FUTEX_WAKE_PRIVATE, 1) = 1
clock_gettime(CLOCK_MONOTONIC, {1342, 328817591}) = 0

t=2020-07-29T01:32:30.194+0800 lvl=warn msg="block exists in BCPool. hash:[f8c7168363f75a731a76aaeb33e9bfdc1799912dd4ba1ed670d5ea10a8f8c64c], height:[319474]." module=pool account=accountChainPool-vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34
t=2020-07-29T01:32:30.194+0800 lvl=info msg="receive account block from network. addr:vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34, height:319473, hash:d2a7c1bb96a2e37e2c64d58d2ddcddcf8b7cc71bf9ce76b2b85bf31f882def2e." module=pool
t=2020-07-29T01:32:30.194+0800 lvl=warn msg="block exists in BCPool. hash:[d2a7c1bb96a2e37e2c64d58d2ddcddcf8b7cc71bf9ce76b2b85bf31f882def2e], height:[319473]." module=pool account=accountChainPool-vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34
t=2020-07-29T01:32:30.195+0800 lvl=info msg="receive account block from network. addr:vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34, height:319472, hash:86b7cb753af53c1e0dfdb79e83c75b3e6fd21f146f05850fb63f3cc071672570." module=pool
t=2020-07-29T01:32:30.195+0800 lvl=warn msg="block exists in BCPool. hash:[86b7cb753af53c1e0dfdb79e83c75b3e6fd21f146f05850fb63f3cc071672570], height:[319472]." module=pool account=accountChainPool-vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34
t=2020-07-29T01:32:30.195+0800 lvl=info msg="receive account block from network. addr:vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34, height:319471, hash:05c32afb1335a84c8f9f9dc1965ae47d0368399b5c827cbbe7aad5c9ad968a80." module=pool
t=2020-07-29T01:32:30.195+0800 lvl=warn msg="block exists in BCPool. hash:[05c32afb1335a84c8f9f9dc1965ae47d0368399b5c827cbbe7aad5c9ad968a80], height:[319471]." module=pool account=accountChainPool-vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34
t=2020-07-29T01:32:30.196+0800 lvl=info msg="receive account block from network. addr:vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34, height:319470, hash:8bb8200025ad9f5e1e8f6a88b074030f534c4cd3f508a36f36d4d8621df0ce6f." module=pool
t=2020-07-29T01:32:30.196+0800 lvl=warn msg="block exists in BCPool. hash:[8bb8200025ad9f5e1e8f6a88b074030f534c4cd3f508a36f36d4d8621df0ce6f], height:[319470]." module=pool account=accountChainPool-vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34
t=2020-07-29T01:32:30.196+0800 lvl=info msg="receive account block from network. addr:vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34, height:319469, hash:deebbff12525310b43ca2a6f004444335c5813db5229b47180bf676e8f718e1e." module=pool
t=2020-07-29T01:32:30.196+0800 lvl=warn msg="block exists in BCPool. hash:[deebbff12525310b43ca2a6f004444335c5813db5229b47180bf676e8f718e1e], height:[319469]." module=pool account=accountChainPool-vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34
t=2020-07-29T01:32:30.196+0800 lvl=info msg="receive account block from network. addr:vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34, height:319468, hash:5b43abed926cf0d3fbbff204b7185b12f5d8c4b2b81e8a87dbf6150d3be3691e." module=pool
t=2020-07-29T01:32:30.196+0800 lvl=warn msg="block exists in BCPool. hash:[5b43abed926cf0d3fbbff204b7185b12f5d8c4b2b81e8a87dbf6150d3be3691e], height:[319468]." module=pool account=accountChainPool-vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34
t=2020-07-29T01:32:30.197+0800 lvl=info msg="receive account block from network. addr:vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34, height:319467, hash:8e486c4a8765078bfc92b9e4d9ea76644192839bcfd45c3cd62abbdfe3149ba4." module=pool
t=2020-07-29T01:32:30.197+0800 lvl=warn msg="block exists in BCPool. hash:[8e486c4a8765078bfc92b9e4d9ea76644192839bcfd45c3cd62abbdfe3149ba4], height:[319467]." module=pool account=accountChainPool-vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34
t=2020-07-29T01:32:30.197+0800 lvl=info msg="receive account block from network. addr:vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34, height:319466, hash:994df3c8a8c13637695121644af6b6d6608eb76a7ad1fdc9ab8fa374f69026bd." module=pool
t=2020-07-29T01:32:30.197+0800 lvl=warn msg="block exists in BCPool. hash:[994df3c8a8c13637695121644af6b6d6608eb76a7ad1fdc9ab8fa374f69026bd], height:[319466]." module=pool account=accountChainPool-vite_48895412bb0959e6a2ae48dcb5e6e7b5695a6bc3c4c3f5bf34
t=2020-07-29T01:32:30.480+0800 lvl=eror msg="sync error: stuck at 36477698" module=net module=syncer
t=2020-07-29T01:32:30.483+0800 lvl=warn msg="stop sync" module=net module=syncer

Latest snapshot block height is 36476498
Delete target height is 36475000
Start deleting, don't shut down. View the deletion process through the log in /root/.gvite/maindata/runlog
fatal error: runtime: out of memory

runtime stack:
runtime.throw(0xf4df36, 0x16)
/usr/local/go/src/runtime/panic.go:608 +0x72
runtime.sysMap(0xc05c000000, 0xc000000, 0x1cfc7d8)
/usr/local/go/src/runtime/mem_linux.go:156 +0xc7
runtime.(*mheap).sysAlloc(0x1cd3f80, 0xc000000, 0x7f0aaa98c2d8, 0xc000063e58)
/usr/local/go/src/runtime/malloc.go:619 +0x1c7
runtime.(*mheap).grow(0x1cd3f80, 0x5428, 0x0)
/usr/local/go/src/runtime/mheap.go:920 +0x42
runtime.(*mheap).allocSpanLocked(0x1cd3f80, 0x5428, 0x1cfc7e8, 0x20300500000000)
/usr/local/go/src/runtime/mheap.go:848 +0x337
runtime.(*mheap).alloc_m(0x1cd3f80, 0x5428, 0xffffffffffff0101, 0xc000063f10)
/usr/local/go/src/runtime/mheap.go:692 +0x119
runtime.(*mheap).alloc.func1()
/usr/local/go/src/runtime/mheap.go:759 +0x4c
runtime.(*mheap).alloc(0x1cd3f80, 0x5428, 0xc000010101, 0x4161c5)
/usr/local/go/src/runtime/mheap.go:758 +0x8a
runtime.largeAlloc(0xa84e2ef, 0x450101, 0x7f0aadecf000)
/usr/local/go/src/runtime/malloc.go:1019 +0x97
runtime.mallocgc.func1()
/usr/local/go/src/runtime/malloc.go:914 +0x46
runtime.systemstack(0x0)
/usr/local/go/src/runtime/asm_amd64.s:351 +0x66
runtime.mstart()
/usr/local/go/src/runtime/proc.go:1229

goroutine 1 [running]:
runtime.systemstack_switch()
/usr/local/go/src/runtime/asm_amd64.s:311 fp=0xc01244a9b8 sp=0xc01244a9b0 pc=0x45a150
runtime.mallocgc(0xa84e2ef, 0xdb5800, 0xc014ca5b01, 0x3f)
/usr/local/go/src/runtime/malloc.go:913 +0x896 fp=0xc01244aa58 sp=0xc01244a9b8 pc=0x40c0c6
runtime.makeslice(0xdb5800, 0xa8246b2, 0xa84e2ef, 0x0, 0x0, 0xffffffffffffff)
/usr/local/go/src/runtime/slice.go:70 +0x77 fp=0xc01244aa88 sp=0xc01244aa58 pc=0x4430b7
github.com/vitelabs/go-vite/common/db/xleveldb.(*Batch).grow(...)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/batch.go:83
github.com/vitelabs/go-vite/common/db/xleveldb.(*Batch).appendRec(0xc0124df700, 0x0, 0xc006c05e40, 0x37, 0x37, 0x0, 0x0, 0x0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/batch.go:94 +0xee fp=0xc01244ab40 sp=0xc01244aa88 pc=0x820dee
github.com/vitelabs/go-vite/common/db/xleveldb.(*Batch).Delete(0xc0124df700, 0xc006c05e40, 0x37, 0x37)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/batch.go:126 +0x63 fp=0xc01244ab90 sp=0xc01244ab40 pc=0x821343
github.com/vitelabs/go-vite/chain/state.(*StateDB).recoverStorageToSnapshot(0xc003261080, 0xc0124df700, 0x22c95da, 0x0, 0x0, 0x107000000, 0x0, 0x0, 0x0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/chain/state/delete.go:470 +0x708 fp=0xc01244ad50 sp=0xc01244ab90 pc=0x9c5918
github.com/vitelabs/go-vite/chain/state.(*StateDB).recoverToSnapshot(0xc003261080, 0xc0124df700, 0x22c95da, 0x0, 0xc01244b228, 0x0, 0xc01244aef8)
/work/vite/git_go/src/github.com/vitelabs/go-vite/chain/state/delete.go:426 +0x175 fp=0xc01244ae58 sp=0xc01244ad50 pc=0x9c50d5
github.com/vitelabs/go-vite/chain/state.(*StateDB).RollbackSnapshotBlocks(0xc003261080, 0xc0001db400, 0x78, 0x80, 0x0, 0x0, 0x0, 0x0, 0x0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/chain/state/delete.go:103 +0xf0a fp=0xc01244b458 sp=0xc01244ae58 pc=0x9c161a
github.com/vitelabs/go-vite/chain.(*chain).deleteSnapshotBlocksToHeight(0xc000500140, 0x22c95db, 0x0, 0x0, 0x0, 0x0, 0x0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/chain/delete.go:197 +0x825 fp=0xc01244b7b0 sp=0xc01244b458 pc=0x9f0375
github.com/vitelabs/go-vite/chain.(*chain).DeleteSnapshotBlocksToHeight(0xc000500140, 0x22c9078, 0xc01244b968, 0x1, 0x1, 0x6b, 0x0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/chain/delete.go:55 +0x35f fp=0xc01244b8b8 sp=0xc01244b7b0 pc=0x9ef5df
github.com/vitelabs/go-vite/cmd/nodemanager.(*RecoverNodeManager).Start(0xc0015f8500, 0x1562640, 0x1cf9888)
/work/vite/git_go/src/github.com/vitelabs/go-vite/cmd/nodemanager/recover_node_manager.go:78 +0x345 fp=0xc01244b9a8 sp=0xc01244b8b8 pc=0xc1b775
github.com/vitelabs/go-vite/cmd/gvite_plugins.recoverLedgerAction(0xc0002bcb00, 0xf38f05, 0x6)
/work/vite/git_go/src/github.com/vitelabs/go-vite/cmd/gvite_plugins/recovercmd.go:32 +0x143 fp=0xc01244ba40 sp=0xc01244b9a8 pc=0xd141c3
github.com/vitelabs/go-vite/cmd/utils.MigrateFlags.func1(0xc0002bcb00, 0x0, 0xc0002bcb00)
/work/vite/git_go/src/github.com/vitelabs/go-vite/cmd/utils/flags.go:264 +0xc1 fp=0xc01244bab8 sp=0xc01244ba40 pc=0xc16611
github.com/vitelabs/go-vite/vendor/gopkg.in/urfave/cli%2ev1.HandleAction(0xdcc280, 0xc0003fe3d0, 0xc0002bcb00, 0xc000068b00, 0x0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/gopkg.in/urfave/cli.v1/app.go:490 +0xc8 fp=0xc01244bae0 sp=0xc01244bab8 pc=0xc03988
github.com/vitelabs/go-vite/vendor/gopkg.in/urfave/cli%2ev1.Command.Run(0xf3aa00, 0x7, 0x0, 0x0, 0x0, 0x0, 0x0, 0xf46d44, 0x14, 0x0, ...)
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/gopkg.in/urfave/cli.v1/command.go:210 +0x990 fp=0xc01244bd50 sp=0xc01244bae0 pc=0xc04d70
github.com/vitelabs/go-vite/vendor/gopkg.in/urfave/cli%2ev1.(*App).Run(0xc000086820, 0xc00002e090, 0x3, 0x3, 0x0, 0x0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/gopkg.in/urfave/cli.v1/app.go:255 +0x687 fp=0xc01244bf28 sp=0xc01244bd50 pc=0xc01ce7
github.com/vitelabs/go-vite/cmd/gvite_plugins.Loading()
/work/vite/git_go/src/github.com/vitelabs/go-vite/cmd/gvite_plugins/load_plugins.go:172 +0x55 fp=0xc01244bf88 sp=0xc01244bf28 pc=0xd133e5
main.main()
/work/vite/git_go/src/github.com/vitelabs/go-vite/cmd/gvite/main.go:13 +0x25 fp=0xc01244bf98 sp=0xc01244bf88 pc=0xd16a95
runtime.main()
/usr/local/go/src/runtime/proc.go:201 +0x207 fp=0xc01244bfe0 sp=0xc01244bf98 pc=0x42d7a7
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1333 +0x1 fp=0xc01244bfe8 sp=0xc01244bfe0 pc=0x45c0b1

goroutine 5 [syscall, 3 minutes]:
os/signal.signal_recv(0x1562c00)
/usr/local/go/src/runtime/sigqueue.go:139 +0x9c
os/signal.loop()
/usr/local/go/src/os/signal/signal_unix.go:23 +0x22
created by os/signal.init.0
/usr/local/go/src/os/signal/signal_unix.go:29 +0x41

goroutine 10 [chan receive, 4 minutes]:
github.com/vitelabs/go-vite/vendor/gopkg.in/natefinch/lumberjack%2ev2.(*Logger).millRun(0xc000068c60)
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/gopkg.in/natefinch/lumberjack.v2/lumberjack.go:379 +0x58
created by github.com/vitelabs/go-vite/vendor/gopkg.in/natefinch/lumberjack%2ev2.(*Logger).mill.func1
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/gopkg.in/natefinch/lumberjack.v2/lumberjack.go:390 +0x79

goroutine 12 [select]:
github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc004db5c00)
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x12a
created by github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x177

goroutine 13 [select, 4 minutes]:
github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc0000864e0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0xd3
created by github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x40c

goroutine 14 [select]:
github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc0000864e0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:101 +0xe7
created by github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/db.go:143 +0x42e

goroutine 15 [select, 4 minutes]:
github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc0000864e0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:804 +0x242
created by github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x58c

goroutine 16 [select, 4 minutes]:
github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc0000864e0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:751 +0x12e
created by github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x5ae

goroutine 33 [select]:
github.com/vitelabs/go-vite/common/db/xleveldb/util.(*BufferPool).drain(0xc004db5ea0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/util/buffer_pool.go:206 +0x12a
created by github.com/vitelabs/go-vite/common/db/xleveldb/util.NewBufferPool
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/util/buffer_pool.go:237 +0x177

goroutine 34 [select, 3 minutes]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).compactionError(0xc000086d00)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:90 +0xd3
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:142 +0x40c

goroutine 35 [select]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).mpoolDrain(0xc000086d00)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_state.go:101 +0xe7
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:143 +0x42e

goroutine 36 [select, 3 minutes]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).tCompaction(0xc000086d00)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:804 +0x242
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:149 +0x58c

goroutine 37 [select, 4 minutes]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).mCompaction(0xc000086d00)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:751 +0x12e
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:150 +0x5ae

goroutine 38 [select]:
github.com/vitelabs/go-vite/common/db/xleveldb/util.(*BufferPool).drain(0xc0024842a0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/util/buffer_pool.go:206 +0x12a
created by github.com/vitelabs/go-vite/common/db/xleveldb/util.NewBufferPool
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/util/buffer_pool.go:237 +0x177

goroutine 39 [select]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).compactionError(0xc000086ea0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:90 +0xd3
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:142 +0x40c

goroutine 40 [select]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).mpoolDrain(0xc000086ea0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_state.go:101 +0xe7
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:143 +0x42e

goroutine 41 [select]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).tCompaction(0xc000086ea0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:804 +0x242
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:149 +0x58c

goroutine 42 [select, 4 minutes]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).mCompaction(0xc000086ea0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:751 +0x12e
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:150 +0x5ae

goroutine 43 [select]:
github.com/vitelabs/go-vite/common/db/xleveldb/util.(*BufferPool).drain(0xc002484460)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/util/buffer_pool.go:206 +0x12a
created by github.com/vitelabs/go-vite/common/db/xleveldb/util.NewBufferPool
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/util/buffer_pool.go:237 +0x177

goroutine 44 [select, 4 minutes]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).compactionError(0xc000087040)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:90 +0xd3
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:142 +0x40c

goroutine 45 [select]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).mpoolDrain(0xc000087040)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_state.go:101 +0xe7
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:143 +0x42e

goroutine 46 [select, 4 minutes]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).tCompaction(0xc000087040)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:804 +0x242
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:149 +0x58c

goroutine 47 [select, 4 minutes]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).mCompaction(0xc000087040)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:751 +0x12e
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:150 +0x5ae

goroutine 48 [select]:
github.com/vitelabs/go-vite/vendor/github.com/patrickmn/go-cache.(*janitor).Run(0xc004357ee0, 0xc0001fb680)
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/patrickmn/go-cache/cache.go:1079 +0xd5
created by github.com/vitelabs/go-vite/vendor/github.com/patrickmn/go-cache.runJanitor
/work/vite/git_go/src/github.com/vitelabs/go-vite/vendor/github.com/patrickmn/go-cache/cache.go:1099 +0xa9

goroutine 18 [select]:
github.com/vitelabs/go-vite/common/db/xleveldb/util.(*BufferPool).drain(0xc002484380)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/util/buffer_pool.go:206 +0x12a
created by github.com/vitelabs/go-vite/common/db/xleveldb/util.NewBufferPool
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/util/buffer_pool.go:237 +0x177

goroutine 19 [select, 4 minutes]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).compactionError(0xc000087ba0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:90 +0xd3
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:142 +0x40c

goroutine 20 [select]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).mpoolDrain(0xc000087ba0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_state.go:101 +0xe7
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:143 +0x42e

goroutine 21 [select, 4 minutes]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).tCompaction(0xc000087ba0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:804 +0x242
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:149 +0x58c

goroutine 22 [select, 4 minutes]:
github.com/vitelabs/go-vite/common/db/xleveldb.(*DB).mCompaction(0xc000087ba0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db_compaction.go:751 +0x12e
created by github.com/vitelabs/go-vite/common/db/xleveldb.openDB
/work/vite/git_go/src/github.com/vitelabs/go-vite/common/db/xleveldb/db.go:150 +0x5ae

goroutine 52 [semacquire, 3 minutes]:
sync.runtime_SemacquireMutex(0xc000500210, 0x0)
/usr/local/go/src/runtime/sema.go:71 +0x3d
sync.(*RWMutex).Lock(0xc000500208)
/usr/local/go/src/sync/rwmutex.go:98 +0x74
github.com/vitelabs/go-vite/chain/flusher.(*Flusher).prepare(0xc000104240, 0x0, 0x0)
/work/vite/git_go/src/github.com/vitelabs/go-vite/chain/flusher/flusher.go:360 +0x3b
github.com/vitelabs/go-vite/chain/flusher.(*Flusher).flush(0xc000104240)
/work/vite/git_go/src/github.com/vitelabs/go-vite/chain/flusher/flusher.go:210 +0x72
github.com/vitelabs/go-vite/chain/flusher.(*Flusher).loopFlush.func1(0xc000104240)
/work/vite/git_go/src/github.com/vitelabs/go-vite/chain/flusher/flusher.go:196 +0x61
created by github.com/vitelabs/go-vite/chain/flusher.(*Flusher).loopFlush
/work/vite/git_go/src/github.com/vitelabs/go-vite/chain/flusher/flusher.go:180 +0x5c

Syncing will consume more ram than usual. When your node was killed and restarted it should start sync immediately, so it's in "sync mode" rather than "synced", that explains why it reports OOM more easily.

2 GB ram is insufficient to run a full node at present. Install 4 GB for your node or create SWAP as an alternative.