Hi everyone,
I’ve been running tests on K10 DR and immutability features for the past 3 weeks. Despite trying many different configurations, I can’t seem to recover a fully functional restore point after restoring Kasten via K10 DR... specifically when I simulate an “unintended deletion of the restore point” before performing the Kasten restoration.
Here’s my use case:
- Create the location profile (with immutability enabled)
- Enable K10 DR
- Run a backup policy (In my test, I’m using an etcd-backup policy based on the official Kasten Blueprint: https://docs.kasten.io/latest/kanister/etcd/ocp/install)
- Run the K10 DR policy
- Delete all existing restore points from the Kasten UI
- Completely destroy Kasten
- Reinstall Kasten
- Create the location profile pointing to the same S3 Bucket
- Restore Kasten via "Kasten Restore" (K10 DR)
- Launch the ETCD restore using the Restore Point, which is now visible again in the Kasten UI after executing "Kasten Restore"
(N.B.: Kasten version used in my tests: v8.5.5)
Observed result:
- Kasten successfully restores the
etcd-detailssecret in theetcd-restorenamespace. - The
prepare-data-job-xxxxpod, which is supposed to fetch the ETCD backup from S3 and place it under/mnt/data/on one of the master nodes, returns the following error:
"Error: Failed to load kopia snapshot with ID: snapshot not found" - No restore errors are visible in the Kasten UI.
Could someone explain why I’m getting this error, given that KDR + Immutability should theoretically allow me to restore my ETCD backup? Is this a limitation related to using a Kanister Blueprint? If so, since database backups (e.g., PostgreSQL) also require Kanister Blueprints, won’t I run into the same issue: where Kopia can’t find the snapshot ID if I try to use a restore point that was "unintended deleted” and then restored via K10 DR?
Any help or insight regarding Kasten's behavior would be greatly appreciated 🙏🙏🙏
Regards,
Samuel
