openethereum/openethereum

Low-level database error on start.

Closed this issue · 1 comments

  • OpenEthereum version (>=3.1.0): v3.3.2-stable-f13fa10b8-20211207
  • Operating system: Arch Linux
  • Installation: Installed from AUR
  • Fully synchronized: I don't know
  • Network: ethereum
  • Restarted: I don't know

Hi. I setup openethereum node few months ago, used it for few days and forgot about it latter. It was still running as daemon in the background. Today I wanted to use it, so I checked system logs to see if its running but they were empty, openethereum didn't log anything since last journal rotation. I tried to restart it but it crashes on start. I expect it to start properly.

Full log:

Jan 19 18:30:22 Thor openethereum[1526451]: 2022-01-19 18:30:22  Starting OpenEthereum/v3.3.2-stable-f13fa10b8-20211207/x86_64-linux-gnu/rustc1.52.1
Jan 19 18:30:22 Thor openethereum[1526451]: 2022-01-19 18:30:22  Keys path /var/lib/openethereum/keys/ethereum
Jan 19 18:30:22 Thor openethereum[1526451]: 2022-01-19 18:30:22  DB path /var/lib/openethereum/chains/ethereum/db/906a34e69aec8c0d
Jan 19 18:30:22 Thor openethereum[1526451]: 2022-01-19 18:30:22  State DB configuration: fast
Jan 19 18:30:22 Thor openethereum[1526451]: 2022-01-19 18:30:22  Operating mode: active
Jan 19 18:30:22 Thor openethereum[1526451]: 2022-01-19 18:30:22  Configured for Ethereum using Ethash engine
Jan 19 18:30:23 Thor openethereum[1526451]: 2022-01-19 18:30:23  Downloading old blocks from 0xf2af4e4e102282c1e6cf77a0cf19a1448cfa3066d2cd8d555c75652dc31ed5e7 (#297473) till Some(0x87582b16ddc8111d85d0cb7998eb50396723c52cdde3a49e79c30cef9e21080d) (#Some(12235001))
Jan 19 18:30:23 Thor openethereum[1526451]: 2022-01-19 18:30:23  Listening for new connections on 127.0.0.1:8546.
Jan 19 18:30:23 Thor openethereum[1526451]: 2022-01-19 18:30:23  Removed existing file '/var/lib/openethereum/jsonrpc.ipc'.
Jan 19 18:30:23 Thor openethereum[1526451]: 2022-01-19 18:30:23  Updated conversion rate to Ξ1 = US$3138.83 (1517095.4 wei/gas)
Jan 19 18:30:28 Thor openethereum[1526451]: 2022-01-19 18:30:28  Public node URL: enode://8500064bfbdcd39c8b3265308fc655685a0b25c8c6a05cb76d213d79fd2c8594a84d03152faa375644644a4bfa2ee63c7224d47ea3679177739a0a7269a4d20f@213.239.220.10:30303
Jan 19 18:30:30 Thor openethereum[1526451]: 2022-01-19 18:30:30  Panic occured, see stderr for details
Jan 19 18:30:30 Thor openethereum[1526451]: ====================
Jan 19 18:30:30 Thor openethereum[1526451]:    0: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:    1: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:    2: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:    3: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:    4: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:    5: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:    6: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:    7: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:    8: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:    9: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:   10: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:   11: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:   12: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:   13: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:   14: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:   15: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:   16: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:   17: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:   18: <unknown>
Jan 19 18:30:30 Thor openethereum[1526451]:   19: start_thread
Jan 19 18:30:30 Thor openethereum[1526451]:   20: __GI___clone
Jan 19 18:30:30 Thor openethereum[1526451]: Thread 'Verifier #1' panicked at 'Low-level database error. Some issue with your hard disk?: Custom { kind: Other, error: "IO error: While pread offset 12611584 len 56580: /var/lib/openethereum/chains/ethereum/db/906a34e69aec8c0d/overlayrecent/db/1751794.sst: Input/output error" }', crates/db/journaldb/src/overlayrecentdb.rs:180
Jan 19 18:30:30 Thor openethereum[1526451]: This is a bug. Please report it at:
Jan 19 18:30:30 Thor openethereum[1526451]:     https://github.com/openethereum/openethereum/issues/new
Jan 19 18:30:30 Thor openethereum[1526451]: 2022-01-19 18:30:30  Finishing work, please wait...
Jan 19 18:30:31 Thor openethereum[1526451]: 2022-01-19 18:30:31  Panic occured, see stderr for details
Jan 19 18:30:31 Thor openethereum[1526451]: ====================
Jan 19 18:30:31 Thor openethereum[1526451]:    0: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:    1: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:    2: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:    3: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:    4: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:    5: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:    6: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:    7: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:    8: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:    9: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   10: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   11: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   12: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   13: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   14: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   15: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   16: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   17: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   18: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   19: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   20: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   21: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   22: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   23: <unknown>
Jan 19 18:30:31 Thor openethereum[1526451]:   24: start_thread
Jan 19 18:30:31 Thor openethereum[1526451]:   25: __GI___clone
Jan 19 18:30:31 Thor openethereum[1526451]: Thread 'event.loop0' panicked at 'Propagating verifier thread panic on shutdown: Any', /build/openethereum/src/openethereum/crates/ethcore/src/verification/queue/mod.rs:864
Jan 19 18:30:31 Thor openethereum[1526451]: This is a bug. Please report it at:
Jan 19 18:30:31 Thor openethereum[1526451]:     https://github.com/openethereum/openethereum/issues/new
Jan 19 18:30:31 Thor openethereum[1526451]: Error: 1
Jan 19 18:30:31 Thor systemd[1]: openethereum.service: Main process exited, code=exited, status=1/FAILURE
Jan 19 18:30:31 Thor systemd[1]: openethereum.service: Failed with result 'exit-code'.

Well, it seems that systemd kept trying to start openethereum and at some point during night it just worked and it seems to be working since then, even if I restart it. I do not think I changed anything at that point in time.
I can't reproduce this anymore.