drolbr/Overpass-API

Invalid `latest_dir` `2024-05-20` points on directory which doesn't exists

scorsi opened this issue · 3 comments

Hello,
I don't know where to post for that,
but the latest_dir in https://dev.overpass-api.de/clone/ points to 2024-05-20 instead of 2024-05-22 which causes failures on cloning because the directory doesn't exists.

It got fixed yesterday.

It got updated with the new date 2024-05-22 once the clone process has finished, but there's still some issue here.

Thank you for reporting the problem. The underlying root cause is that the hard disk of dev.overpass-api.de got very slow (around 5-10 MB/s) over time and needs a replacement.

There have been considerations to move clone generation to a different machine which should have combined virtualization with Ansible, and various people did disagree how to do that in the right way. As a mitigation the clone generation has been reduced from daily to three times a week some time ago, and I will transition to twice a week now to give the slowing hard disk more time.

Another mitigation is to replicate as many files as possible client side. There is a partial implementation for the next release, but it has not been tested so far.

All in all, I'll leave this open as a task to ensure it can be tacked when one of the approaches to

  • reduce the amount of data to transmit
  • move to a new server
    has come to fruition.