• EN

Replies posted by jaiganeshjk

239 Comments

L
lidw123Not a newbie anymore
posted in Kasten K10 Support

kasten access error upstream request timeout

Would you be able to share the logs from auth-svc if the authentication is causing issues ?Since this might involve an engaged debugging, would you be able to open a case in https://my.veeam.com/ selecting Kasten by Veeam K10 TrIal under product ? 

8
L
13 days ago
R
RaffNot a newbie anymore
asked in Kasten K10 Support

"mkdir /var/reports/clustergraceperiod: permission denied" during k10 deployment

Yea I am not sure what causes the change in the ownership in your NFS and based on what settings ?Is there a CSI driver involved in provisioning and managing the NFS PVCs ?

8
R
8 days ago
L
lidw123Not a newbie anymore
posted in Kasten K10 Support

kasten access error upstream request timeout

@lidw123 Would you be able to share a brief explanation on the issue that you are seeing in K10 ?Were you not able to access K10 dashboards ? Any particular jobs failing ?The above logs from aggregated-api pods shows that the connection from that pod to catalog-svc is being refused. If the catalog-svc pod is not running, That would be the reason for this error.If the pod doesn’t have any issue and is ready, There could be something with the network connectivity between the pods.You can manually try calling catalog’s healthz endpoint from aggregatedapis-svc pod.```kubectl exec -it deploy/aggregatedapis-svc -n kasten-io -- curl http://catalog-svc:8000/v0/healthz```

8
L
13 days ago
T
ta.arNew Here
posted in Kasten K10 Support

Export Job Failed

Thanks for opening a post here.Would you be able to add additional details about the set up ?What is the storageClass that you are using for the PVC ? Were you able to run the pre-flight checks against this storageclass ?https://docs.kasten.io/latest/install/storage.html#pre-flight-checks  

2
jaiganeshjk
14 days ago
P
peterturnipComes here often
asked in Kasten K10 Support

Kasten K10 DR custom S3 prefix

@peterturnip Thanks for reporting this.This seems to be a problem that we are not taking the custom path for S3 profile in account while generating path for DR restore. We don’t have a way to configure this with helm at the moment. Ideally, we should be using the path from the profile even during the DR restore.I will file a bug internally to get this fixed.

2
jaiganeshjk
14 days ago
R
RaffNot a newbie anymore
asked in Kasten K10 Support

"mkdir /var/reports/clustergraceperiod: permission denied" during k10 deployment

@Raff Thanks for opening a topic here. These logs show that the errors are because of the permissions in the NFS PVC.If you are using an NFS for K10 PVCs, Then the ownership and permissions of these NFS needs to be updated manually.K10 uses a user 1000 for all its pods and uid 472 for grafana. You will have to manually update the ownership of the NFS path’s that gets provisioned for these PVCs. The reason for this is because, Most of the CSI drivers/NFS PVCs doesn’t support ownership changes based on the fsGroup value set in the worloads.For K10 PVCs, you can try  chown 1000:1000 /path/to/nfs And for Grafana PVC, You will have to run it as root if you haven’t disabled init-chown-data container. chown root:root /path/to/nfs # this will be changed to 472:472 after the init container completes or if init-chown-data container is disabled, chown 472:472 /path/to/nfs 

8
R
8 days ago
V
Vecteur ITComes here often
asked in Kasten K10 Support

Failed to create snapshot CSI driver

@Vecteur IT The error message seems different. It says that the it cannot get the claim (which is persistentvolumeclaim here).Are you creating the volumesnapshot in the same namespace as the PVC ?I see that the volumesnapshot is in default namespace. And can you also confirm if the PVC powerdns-pvc is also in default namespace ?

8
V
1 month ago
A
alifiroozi80New Here
asked in Kasten K10 Support

EFS Storage Class Backup

@alifiroozi80 From the logs, It seems that k10 is using shareable volume backup and I assume you are using dynamically provisioned EFS PVCs because of that. We found a problem with this workflow with some versions of k10 starting from 6.0.7.We have already fixed this in latest version of k10 and upgrading to the latest version will resolve this issue for you.

9
jaiganeshjk
1 month ago
V
Vecteur ITComes here often
asked in Kasten K10 Support

Failed to create snapshot CSI driver

@Vecteur IT Thanks for creating this topic.From the error message, It seems that the csi-snapshotter is failing to create the snapshot in the storage backend due to the unavailability of the credentials/secret reference.Do you have px-security enabled ? Does your volumesnapshotClass have fields like csi.storage.k8s.io/snapshotter-secret-name & csi.storage.k8s.io/snapshotter-secret-namespace under parameters ?https://docs.portworx.com/portworx-enterprise/operations/operate-kubernetes/storage-operations/csi/dataprotection.html#take-local-snapshots-of-csi-enabled-volumes

8
V
1 month ago
P
peterturnipComes here often
asked in Kasten K10 Support

Kasten - custom migration tokens

@peterturnip , Thanks for opening this topic.This migrationToken/receiveString is a encoded string that policy controller in k10 creates and adds to the policy. This basically has the metadata about the export location, connection parameters etc. You cannot specify a custom migration string to use it for import.It must be created by k10 based on few variables in your location profile and the policy that you are creating.  

2
jaiganeshjk
2 months ago
S
sriramadasuNew Here
asked in Kasten K10 Support

Cant port forward the Gateway service and cant access dashboard

@sriramadasu Thanks for opening this topic,We recently moved the gateway svc port from 8000 to 80.Ideally, the below port-forward command should work for you to access K10kubectl --namespace kasten-io port-forward service/gateway 8080:80Documentation - https://docs.kasten.io/latest/access/dashboard.html#access-via-kubectl Please try it out and let me know if this doesn’t work.

7
Hagag
2 months ago
P
pascalzeroNew Here
asked in Kasten K10 Support

Will Kasten use Shallow Read-Only CephFS snapshots?

Seems to have been fixed in 3.10 version of ceph CSIhttps://github.com/ceph/ceph-csi/releases/tag/v3.10.0

20
jaiganeshjk
2 months ago
P
pascalzeroNew Here
asked in Kasten K10 Support

Will Kasten use Shallow Read-Only CephFS snapshots?

Basically, You don’t change the existing storageClass that you use(as restores from local volumesnapshot will fail when you do that).Instead, create a new storageClass with backingSnapshot parameter set to true and use the override in the policy.  Below note is important as well as you will need to preserve SELinux options while using CephFS shallow volume copy for export. This annotation should be added to the original storageClass. Additionally, in the case of SELinux usage, it may be necessary to preserve SELinuxOptions of the original Pod into the Kanister Pod during the Export phase.$ kubectl annotate storageclass regular-cephfs-csi-storage-class \ k10.kasten.io/sc-preserve-selinux-options="true" 

20
jaiganeshjk
2 months ago
P
pascalzeroNew Here
asked in Kasten K10 Support

Will Kasten use Shallow Read-Only CephFS snapshots?

@voarsh Thanks for your comment.Using this feature requires a special StorageClass, which is usually a copy of the regular StorageClass of the CephFS CSI driver, but with the backingSnapshot: "true" option in the parameters sectionYou will need to create a new storageClass with the parameter backingSnapshot set to true. Here’s the example from the CephFS github that shows how to add `backingSnapshot` parameter.https://github.com/ceph/ceph-csi/blob/devel/examples/cephfs/storageclass.yaml In order to use shallow copy, PVCs that you create with the volumesnapshot as a dataSource needs to use this storageClass. In case of K10 exports, There is a way to override which storageClass to use when doing a clone, that’s where the exporterStorageClassName comes in to picture. This override resides in the policy CR of k10.You will have to specify the storageClass name that has backingSnapshot set to true in place of exporterStorageClassName. Let me know if it makes sense.

20
jaiganeshjk
2 months ago
P
pascalzeroNew Here
asked in Kasten K10 Support

Will Kasten use Shallow Read-Only CephFS snapshots?

Hi all,Just to keep you all informed that much awaited support for shallow read-only volume snapshots for cephFS during export operations is available in k10 from version 6.5.2Here's the documentation for the same.https://docs.kasten.io/latest/install/storage.html#snapshots-as-shallow-read-only-volumes-cephfs-only

20
jaiganeshjk
2 months ago
W
WWK-Cloud-PlattformNot a newbie anymore
asked in Kasten K10 Support

Error 400 when activatingK10 DR

@WWK-Cloud-Plattform Thanks for opening this topic.This is a bug that was introduced in 6.5.1 and we have fixed this in 6.5.2.We also have tests in place now to mitigate this in future. Please try to upgrade(https://docs.kasten.io/latest/install/upgrade.html#upgrading-k10) to 6.5.2 and you should be good with this problem. 

3
W
3 months ago
Y
yvanbroccardNew Here
asked in Kasten K10 Support

K10 using the wrong VolumeSnapShotClass when multiple StorageClasses with same driver

Hi @yvanbroccard , Thank you for posting this question here.Yes, Instead of annotating the volumeSnapshotClass, you will have to annotate the storageClass with the annotation as specified in the documentation https://docs.kasten.io/latest/install/storage.html#storageclass-configuration You will need to remove the annotations from all the volumeSnapshotClass and then annotate each storageClass with the corresponding volumeSnapshotClass name k10.kasten.io/volume-snapshot-class=${VSC_NAME}

1
jaiganeshjk
3 months ago
D
donaldleungComes here often
asked in Kasten K10 Support

Does K10 cluster-scoped resource backup include IngressClasses?

Below is the sample YAML reference to the policy if you prefer to edit the manifest to add the filters instead of UI form.kind: PolicyapiVersion: config.kio.kasten.io/v1alpha1metadata: name: jai-test-cluster-scoped-policy namespace: kasten-iospec: frequency: "@onDemand" selector: matchExpressions: - key: k10.kasten.io/appNamespace operator: In values: - kasten-io-cluster actions: - action: backup backupParameters: filters: includeClusterResources: - group: networking.k8s.io version: v1 resource: ingressclasses - group: actions.kio.kasten.io resource: defaults 

6
D
3 months ago
D
donaldleungComes here often
asked in Kasten K10 Support

Does K10 cluster-scoped resource backup include IngressClasses?

Here is the result of artifacts from the ClusterRestorepoint before and after adding the include filter for ingressClasses.Before adding the filterAfter adding the filter 

6
D
3 months ago
D
donaldleungComes here often
asked in Kasten K10 Support

Does K10 cluster-scoped resource backup include IngressClasses?

Thanks for your patience.I found that we only backup ClusterRoles, ClusterRolebindings, StorageClass and CRDs as a part of cluster-scoped resources. And anything else needed should be explicitly included using filters. By default, Include filters will only include the resource that you add as a part of the filter.In this case, if you add an include filter for an ingressClass resource, only it will be included.However, there is a way to add another filter to include the default resources backed up as a part of cluster-scoped resource backup. You will have to add an include filter entry for Group: actions.kio.kasten.io and Resource: defaults. Below is a screenshot showing how to add an include filter for a cluster-scoped resource to include the ingressClasses and the defaults.  

6
D
3 months ago
D
donaldleungComes here often
asked in Kasten K10 Support

Does K10 cluster-scoped resource backup include IngressClasses?

@donaldleung Thanks for opening this topic.I don’t have the exhaustive list of the cluster-scoped resources that K10 backs up. But I might have a way to add include filters for certain CRDs along with the defaults.I will share the details here shortly on how to do that. PS: I am also working on publishing a KB article with these details along with the list cluster-scoped resources that K10 backups by default. I will publish that quickly so that it can be of help here. 

6
D
3 months ago
H
hafesiComes here often
asked in Kasten K10 Support

Login Failed create signed Token

Thanks for creating a topic here.From the quick look, I see that you have mentioned your group name in the groupClaim field.Groups Claim specifies the name of the claim in the token holding the group names and/or paths.groupClaim is usually `groups` . You could try changing it and see if it helps.auth-svc/dex container logs in auth-svc pod might have some useful insights. You can look at the details that we are receiving from the token from your OIDC provider in these container logs.

2
H
4 months ago
S
Shubhadip PalComes here often
asked in Kasten K10 Support

K10 Multi-cluster dashboard not showing applications from all the cluster

Oh. Then I might have an idea what might be the issue.It could be because the operator might remove the federation config from the prometheus configMap after the bootstrap of the secondary is completed. One thing we could do is to wait for the next release 6.5 to resolve this issue.From the new release, K10 will not be relying on the prometheus federation to get the metrics from the secondary clusters. It will use a different messaging mechanism to get the metrics from the secondary cluster going forward. So this issue will get automatically resolved with this. Still I will file an issue internally with the engineering to look into this.

8
S
4 months ago
S
Shubhadip PalComes here often
asked in Kasten K10 Support

K10 Multi-cluster dashboard not showing applications from all the cluster

@Shubhadip Pal Thanks. This means that the prometheus doesn’t have the federation config.Just one more question for me to understand why the prometheus doesn’t have the federation config.Are you using K10 operator based installation for your primary K10 instance ?

8
S
4 months ago
M
mdavis
asked in Kasten K10 Support

K10 using deprecated Apis - Upgrade from 1.25 to 1.26

@mdavis Thanks for posting your question here.K10 6.0.12 support till 1.27(https://docs.kasten.io/latest/operating/support.html#supported-kubernetes-versions). So you should have any issues in running with 1.26.The message is about snapshot API version and v1beta1 version is deprecated in 1.24 itself.Its not from K10 but it comes when K10 tries to list/get the snapshot. 

2
M
5 months ago

Badge winners

Show all badges
Terms & Conditions