rancher/backup-restore-operator

Restoreprocess hangs in loop because of Error

Closed this issue · 1 comments

Rancher Server Setup

  • Rancher version: 2.8.2
  • Installation option (Docker install/Helm Chart): Helm
  • Kubernetes Version and Engine: RKE2 1.27.11

Describe the bug
Backup local cluster on S3 with the backup-Application. Setting up fresh RKE2 Cluster (same version), installing rancher (same version), then restoring from s3 bucket - get stuck in restoring loop in rancher-backup pod.

To Reproduce

  1. backup cluster to s3
  2. restore cluster on freshly RKE2/Rancher cluster from same s3
  3. get stuck on backup task with error at the end:
INFO[2024/03/25 14:20:21] Successfully restored library-neuvector-1.7.6
INFO[2024/03/25 14:20:21] Processing controllerRef apps/v1/deployments/rancher
INFO[2024/03/25 14:20:21] Scaling up controllerRef apps/v1/deployments/rancher to 3
ERRO[2024/03/25 14:20:21] Error restoring namespaced resources [error restoring downstream-cluster-1 of type provisioning.cattle.io/v1, Resource=clusters: restoreResource: err updating resource admission webhook "rancher.cattle.io.clusters.provisioning.cattle.io" denied the request: creatorID annotation cannot be changed]  
ERRO[2024/03/25 14:20:21] error syncing 'restore-lnhtb': handler restore: error restoring namespaced resources, check logs for exact error, requeuing
INFO[2024/03/25 14:20:21] Processing Restore CR restore-lnhtb
INFO[2024/03/25 14:20:21] Restoring from backup daily-6ee9660f-846a-4831-917d-f2d4781f1225-2024-03-25T12-00-00Z.tar.gz

Expected behavior
restoreprocess coming to an end and starting rancher instance

Additional context
tried the flag ignoreErrors: True - then it finishes somehow but downstramcluster are broken.

meantime i found out that the restore-procedure ist NOT meant to be done on a different (new) cluster. This use-case is called "migration" in the docs and described here: https://ranchermanager.docs.rancher.com/how-to-guides/new-user-guides/backup-restore-and-disaster-recovery/migrate-rancher-to-new-cluster

if you follow the procedure for "Migrating Rancher to a New Cluster", the restore works just fine.