Merkle Blocks Not Downloading

Question

Merkle Blocks Not Downloading

Closed this issue 7 years ago · 6 comments

This issue was original filed in the openbazaar-go repo. Moving here, as @cpacia felt it was more appropriate.

Answer 1 · 2017-12-31T16:50:58.000Z

I'm using the latest version of the master branch of the go server, using a BCH wallet, and I'm still seeing this issue. What's interesting is that the Merkle block error appears to have fixed itself, but the transactions in the UI still appear to be 'stuck'.

This issue appears to be preventing my store from conducting sales. From experience, I've learned that I can reboot my server to fix this problem. But that's not a very good solution to permanently connected servers.

Here is the tail end of the bitcoin.log:

trout@p2pvps:~/.p2pvps/openbazaar/logs$ tail --lines=100 bitcoin.log
15:53:49.985 [onMerkleBlock] [WARNING] Header 0000000000000000009379c9007b9e886e8fa544edc2553b1d690915e1e9517b does not extend any known headers
15:53:50.249 [onMerkleBlock] [WARNING] Header 0000000000000000009379c9007b9e886e8fa544edc2553b1d690915e1e9517b does not extend any known headers
15:53:50.279 [onMerkleBlock] [WARNING] Header 0000000000000000009379c9007b9e886e8fa544edc2553b1d690915e1e9517b does not extend any known headers
15:53:50.442 [onMerkleBlock] [WARNING] Header 0000000000000000009379c9007b9e886e8fa544edc2553b1d690915e1e9517b does not extend any known headers
15:53:50.597 [onMerkleBlock] [WARNING] Header 0000000000000000009379c9007b9e886e8fa544edc2553b1d690915e1e9517b does not extend any known headers
15:53:50.719 [onMerkleBlock] [WARNING] Header 0000000000000000009379c9007b9e886e8fa544edc2553b1d690915e1e9517b does not extend any known headers
15:53:52.525 [onMerkleBlock] [WARNING] Header 0000000000000000009379c9007b9e886e8fa544edc2553b1d690915e1e9517b does not extend any known headers
15:53:52.771 [onMerkleBlock] [WARNING] Header 0000000000000000009379c9007b9e886e8fa544edc2553b1d690915e1e9517b does not extend any known headers
16:03:06.470 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:03:06.492 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:03:06.542 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:03:06.704 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:03:06.968 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:03:07.240 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:03:07.475 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:03:08.351 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:03:08.813 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:03:09.855 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:03:12.263 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:03:13.403 [onMerkleBlock] [WARNING] Header 000000000000000003000fe28e01dd19ef627b54e81ca2b3347ff3fef583523b does not extend any known headers
16:13:27.392 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:13:27.393 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:13:27.504 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:13:27.661 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:13:27.820 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:13:28.083 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:13:28.341 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:13:28.356 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:13:28.380 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:13:28.642 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:13:29.166 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:13:30.559 [onMerkleBlock] [WARNING] Header 0000000000000000020350d8678953b63f40c65796ec310584194f00b3f8d1f5 does not extend any known headers
16:16:12.565 [onTx] [DEBUG] Tx 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a from Peer12 had no hits, filter false positive.
16:16:13.782 [onTx] [DEBUG] Tx 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a from Peer9 had no hits, filter false positive.
16:16:13.792 [onTx] [DEBUG] Tx 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a from Peer8 had no hits, filter false positive.
16:16:15.923 [onTx] [DEBUG] Tx 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a from Peer6 had no hits, filter false positive.
16:16:16.502 [onTx] [DEBUG] Tx 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a from Peer7 had no hits, filter false positive.
16:16:20.096 [onTx] [DEBUG] Tx 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a from Peer13 had no hits, filter false positive.
16:16:20.120 [updateFilterAndSend] [DEBUG] Sent filter to Peer13
16:16:20.120 [fPositiveHandler] [DEBUG] Reset 8 false positives for Peer13
16:22:49.121 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:49.131 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:22:49.156 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:49.157 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:49.164 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:22:49.202 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:22:49.411 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:49.767 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:22:49.818 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:49.827 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:22:49.924 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:49.940 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:22:49.993 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:50.024 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:50.221 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:22:50.221 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:50.357 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:22:50.533 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:22:50.845 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:50.854 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:51.366 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:22:51.371 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:22:52.377 [onMerkleBlock] [WARNING] Header 000000000000000003be0beecc4a72273c1a97e1d1b7fdd2fe5c831843b33296 does not extend any known headers
16:22:52.936 [onTx] [WARNING] Received unqued tx id: 591b3aae6afc2dfa4d22d1d197a3cb05702fd15ef9b89ab3bad817000318b73a
16:31:44.929 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:31:44.969 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:31:45.049 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:31:45.288 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:31:45.436 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:31:45.625 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:31:45.802 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:31:45.882 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:31:45.889 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:31:46.106 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:31:46.240 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:31:47.964 [onMerkleBlock] [WARNING] Header 00000000000000000258cb1812769dc26514516c9eba4a7cf0b94466b3031c2f does not extend any known headers
16:39:43.289 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:39:43.342 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:39:43.358 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:39:43.592 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:39:43.892 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:39:44.085 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:39:44.242 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:39:44.302 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:39:44.307 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:39:44.785 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:39:44.837 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:39:46.099 [onMerkleBlock] [WARNING] Header 00000000000000000240812f55fc6b92377b078cf9796eaa365a96632a3ebea0 does not extend any known headers
16:43:18.696 [updateFilterAndSend] [DEBUG] Sent filter to Peer12
16:43:18.696 [onTx] [INFO] Tx 09f34b9afbc4f093ee7273bfc649b712bc2916f227c16c3f3cdf4f448a620071 from Peer12 ingested at height 0
16:43:20.068 [updateFilterAndSend] [DEBUG] Sent filter to Peer8
16:43:20.068 [onTx] [INFO] Tx 09f34b9afbc4f093ee7273bfc649b712bc2916f227c16c3f3cdf4f448a620071 from Peer8 ingested at height 0
16:43:20.859 [updateFilterAndSend] [DEBUG] Sent filter to Peer7
16:43:20.859 [onTx] [INFO] Tx 09f34b9afbc4f093ee7273bfc649b712bc2916f227c16c3f3cdf4f448a620071 from Peer7 ingested at height 0
16:43:23.867 [updateFilterAndSend] [DEBUG] Sent filter to Peer6
16:43:23.867 [onTx] [INFO] Tx 09f34b9afbc4f093ee7273bfc649b712bc2916f227c16c3f3cdf4f448a620071 from Peer6 ingested at height 0
16:43:28.313 [updateFilterAndSend] [DEBUG] Sent filter to Peer9
16:43:28.313 [onTx] [INFO] Tx 09f34b9afbc4f093ee7273bfc649b712bc2916f227c16c3f3cdf4f448a620071 from Peer9 ingested at height 0
16:43:31.570 [updateFilterAndSend] [DEBUG] Sent filter to Peer13
16:43:31.570 [onTx] [INFO] Tx 09f34b9afbc4f093ee7273bfc649b712bc2916f227c16c3f3cdf4f448a620071 from Peer13 ingested at height 0

Answer 2 · 2017-12-31T16:53:09.000Z

I take back what I said. This issue is not necessarily stopping transactions, but unconfirmed transactions stack up and eventually stop sales. I'm not sure about the code that governs this, but that's been my experience.

Answer 3 · 2018-01-04T00:54:19.000Z

Wanted to add that I've left my internet-connected VPS running for 4 days and the confirmations still haven't come through. The bitcoin log is full of statements like this:

00:49:50.106 [onMerkleBlock] [WARNING] Header 00000000000000000190d8205c0305f14edd87f046866a2648d112ab3b00667f does not extend any known headers
00:49:50.328 [onMerkleBlock] [WARNING] Header 00000000000000000190d8205c0305f14edd87f046866a2648d112ab3b00667f does not extend any known headers
00:49:50.360 [onMerkleBlock] [WARNING] Header 00000000000000000190d8205c0305f14edd87f046866a2648d112ab3b00667f does not extend any known headers
00:49:50.733 [onMerkleBlock] [WARNING] Header 00000000000000000190d8205c0305f14edd87f046866a2648d112ab3b00667f does not extend any known headers

I'm going to reboot the server and see if that fixes it.

Answer 4 · 2018-01-05T16:54:13.000Z

@cpacia The BCH wallet I mentioned above has been stuck for 5 days, through several server reboots. I've zipped the entire data directory, with logs. Private message me on Slack and I'll send it to you. It's about 25 megs.

Answer 5 · 2018-01-05T17:29:55.000Z

Have you clicked resync blockchain? I'm pretty sure there's a fork on the testnet.

Answer 6 · 2018-01-10T21:25:29.000Z

@cpacia and I finally got to the bottom of this issue. The cause, it turned out, was because my Docker container was initializing the data directory using the start command. That built everything as a BTC wallet. I was running the openbazaar-go repo on a stand-alone server, inside a Docker container.

I was then shutting down the Docker container and replacing the config file with one geared to BCH. That was causing the errors seen in this issue.

The solution was to:

Shut down the Docker container.
Delete the headers.bin file in the OB data directory.
Start the Docker container again.
In the client, go to Settings->Advanced and click the Reload Transactions
Give it some time to start downloading valid Merkle blocks.

Wallet fixed.