Solved

K10 backups prevented by new RKE2 Snapshot Validation Webhook


RKE2 v1.26.2  is now bundled with a snapshot validation webhook (https://github.com/rancher/rke2/pull/3944) which prevent K10 backups :

 

            message: 'Failed to create snapshot resource k10-csi-snap-b926xgtp79mbbq6w,
Namespace xxxxxx: admission webhook
"rke2-snapshot-validation-webhook.csi.kubernetes.io" denied the
request: expect resource to be {snapshot.storage.k8s.io v1
volumesnapshots}, {snapshot.storage.k8s.io v1
volumesnapshotcontents} or {snapshot.storage.k8s.io v1
volumesnapshotclasses}'

 

icon

Best answer by Geoff Burke 23 March 2023, 12:04

View original

4 comments

Userlevel 7
Badge +22

I could be wrong but if RKE 1.26.2 is what I think it is :) i.e. version 1.26 then I don’t think Kasten have added support yet. They normally need some time for testing and dealing with new things like this, hence the delay in support

 

Check the release notes here https://docs.kasten.io/latest/releasenotes.html

 

cheers

Userlevel 7
Badge +22

There is an effort to try and tighten the controls around snapshots so it makes sense as stated here that the distribution would introduce this. 

 

https://kubernetes-csi.github.io/docs/snapshot-validation-webhook.html

Userlevel 6
Badge +2

You could try removing the older apiVersions for snapshot CRDs from your cluster just keeping the V1.

K10 supports V1 snapshot CRDs as well.

Thanks, I removed the whole Validation Webhook until this get fixed and backups are now OK:

 kubectl delete Validatingwebhookconfigurations/rke2-snapshot-validation-webhook

 

Comment