node stopped: Assertion `me->second->msid==nowmsid' failed

[PawelPodkalicki]

Node stopped with assertion error

[1529933770] OFFICER ready 0005
[1529933770] OFFICE online 8
adsd: /ads_repo/src/escd/server.hpp:966: void server::LAST_block_msgs(): Assertion `me->second->msid==nowmsid' failed.
[1529933770] OFFICE new ticket (total open:1)
[1529933770] Client entered 195.201.235.10:44278
[1529933770] 
SIGNAL: 6

Issue was reported to Mr Sylwester Raczyński.

[PawelPodkalicki]

Full log from node2 and last seconds from node2 and node5 are available in 20180625_assertion_fail_nowmsid.zip

[PawelPodkalicki]

Same assertion failed again. Node stopped.

[1530710143] 000D HASH 00100000010D03CC [00100000010DCC04] (update) 0010:0000010D
[1530710143] 000D DELIVERED MESSAGE 0010:0000010D 04 (len:8) [total 8730b 313f]
[1530710143] 000D UPDATE PEER SVID_MSID: 0010:0000010D
[1530710143] 0010 [0010-0000010D] [l:112] (5B3CC878) ; TRY UPDATE
[1530710143] 0010 [0010-0000010D] [l:112] (5B3CC878) ; NO UPDATE
[1530710143] 0010 [0010-0000010D] [l:112] (5B3CC878) ; TRY UPDATE
[1530710143] 0010 [0010-0000010D] [l:112] (5B3CC878) ; NO ECHO
[1530710143] 0010 [0010-0000010D] [l:112] (5B3CC878) ; TRY UPDATE
[1530710143] 0010 [0010-0000010D] [l:112] (5B3CC878) ; NO UPDATE
[1530710143] 0010 [0010-0000010D] [l:112] (5B3CC878) ; TRY UPDATE
[1530710143] 0013 MESSAGE detected ! (UPDATE)
[1530710143] 0013 HASH 00100000010D03ED [00100000010DED04] (update) 0010:0000010D
[1530710143] 0010 [0010-0000010D] [l:112] (5B3CC878) ; TRY UPDATE
[1530710143] 0014 MESSAGE detected ! (UPDATE)
[1530710143] 0014 HASH 00100000010D030B [00100000010D0B04] (update) 0010:0000010D
[1530710143] 0013 DELIVERED MESSAGE 0010:0000010D 04 (len:8) [total 83418b 3050f]
[1530710143] 0013 UPDATE PEER SVID_MSID: 0010:0000010D
[1530710143] 0014 DELIVERED MESSAGE 0010:0000010D 04 (len:8) [total 85621b 3211f]
[1530710143] 0014 UPDATE PEER SVID_MSID: 0010:0000010D
[1530710144] SENDING message 0000011A
[1530710144] ERROR, waiting for new block, postponing message write
[1530710144] ERROR sending message 0000011A
[1530710144] STOP header received
[1530710144] 0006 PEER in block mode
[1530710144] 0006 PEER got STOP
[1530710144] 0006 LAST HASH got A8BA0917BB5910E8C6F20EA49676FC8F610E6C71BC46A922184E01E063E731A0
[1530710144] sync_start 0
[1530710144] sync_start2 0
[1530710144] 0006 PEER sync_start wait
[1530710144] CLOCK: 00 (check:0 wait:2 peers:16 allpeers:16 hash:46D755DC now:5B3CC860 msg:31 txs:62) [] (miss:1:000E000000D703CC)
[1530710144] STOPing validation to start block
[1530710144] STOPed validation to start block
[1530710144] ELECTOR accepted:0001 (blk)
[1530710144] ELECTOR accepted:0002 (blk)
[1530710144] ELECTOR accepted:0003 (blk)
[1530710144] ELECTOR accepted:0004 (blk)
[1530710144] ELECTOR accepted:0006 (blk)
[1530710144] ELECTOR accepted:0007 (blk)
[1530710144] ELECTOR blk ignore 0008 (invalid)
[1530710144] ELECTOR blk ignore 0009 (invalid)
[1530710144] ELECTOR blk ignore 000A (invalid)
[1530710144] ELECTOR blk ignore 000B (invalid)
[1530710144] ELECTOR blk ignore 000C (invalid)
[1530710144] ELECTOR blk ignore 000D (invalid)
[1530710144] ELECTOR blk ignore 000F (invalid)
[1530710144] ELECTOR blk ignore 0010 (invalid)
[1530710144] ELECTOR blk ignore 0012 (invalid)
[1530710144] ELECTOR blk ignore 0013 (invalid)
[1530710144] ELECTOR blk ignore 0014 (invalid)
[1530710144] ELECTOR[1]=039509C58B47A388
[1530710144] ELECTOR[2]=0393A09984D39F3E
[1530710144] ELECTOR[3]=0392376D808E69E3
[1530710144] ELECTOR[4]=0390CE417A12C680
[1530710144] ELECTOR[6]=038DFBE96F51EBAD
[1530710144] ELECTOR[7]=038C92BD6B1460AE
[1530710144] ELECTOR max:15663EB4E522BF84
adsd: /ads_repo/src/escd/server.hpp:965: void server::LAST_block_msgs(): Assertion `me->second->msid==nowmsid' failed.
[1530710144] 
SIGNAL: 6

[PawelPodkalicki]

Load tests didn't trigger this error.