Hi Team, My all pod is running but still i am not able to create snapshot. when i am clicking yes continue i am getting below error:kubectl logs dashboardbff-svc-5d47d4695f-qj64m -c dashboardbff-svc -n kasten-io

Not able to create snapshot all pod are running.

Hi @ntiwari38

Can you get the output for following? or attach the debug logs ?

kubectl get apiservices |grep -i kasten

From the 1st screenshot , I see the prometheus pod is not scheduled where in your 3rd screenshot you are seeing those errors . That doesn't impact your K10 Backup services.

Regards
Satish

@jaiganeshjk

@ntiwari38 In addition to what Satish had asked, Can you confirm if the useraccount that you are using to access K10 UI, is a K10-admin/Cluster-admin user ?

Or is it just a namespace admin or a basic user with access to few namespace ?

The RunOnce action is an admin action and can only be done by a user with cluster-admin privilege or at-least with the privilege to create runaction resource(which is a cluster-scoped resource at the moment)

@Satish Thanks for reply.

Please find the below screenshot.

Hi @ntiwari38 ,

Thanks for the output .
apiservices looks good .

looking into debug logs will help identifying the issue .

in UI -> Settings -> Support - download logs .

As Jai stated , is the user account used is cluster admin or restricted to specific namespaces ?

@Satish

this account is for cluster admin

Please find the debug log

http://C:\Users\ntiwari38\Downloads\k10logs.zip\k10logs

# K10: Describing K10 pods
kubectl --namespace ${k10_ns} describe pods
Name: aggregatedapis-svc-867c46b459-s25d5
Namespace: kasten-io
Priority: 0
Node: znlapcdp07442v/10.147.155.146
Start Time: Mon, 27 Feb 2023 16:37:44 +0000
Labels: app=k10
app.kubernetes.io/instance=k10
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=k10
component=aggregatedapis
helm.sh/chart=k10-5.5.4
heritage=Helm
pod-template-hash=867c46b459
release=k10
run=aggregatedapis-svc
Annotations: checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
cni.projectcalico.org/containerID: 94d1f6c4930773626247fc8a455cc54b5a3396a330c70d54bef7e5c61600c788
cni.projectcalico.org/podIP: 192.168.176.238/32
cni.projectcalico.org/podIPs: 192.168.176.238/32
Status: Running
IP: 192.168.176.238
IPs:
IP: 192.168.176.238
Controlled By: ReplicaSet/aggregatedapis-svc-867c46b459
Containers:
aggregatedapis-svc:
Container ID: docker://ba86cf6b4484e58ba5e7ee5acb16d365a5dd5a3f59b04dcd86c945f5aee84ca8
Image: gcr.io/kasten-images/aggregatedapis:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/aggregatedapis@sha256:d417354a3d460f2e380cbc700c593f5f30b135303fb97e7fdd1ca7da3c6d3b3c
Port: 10250/TCP
Host Port: 0/TCP
Args:
--secure-port=10250
--cert-dir=/tmp/apiserver.local.config/certificates/
State: Running
Started: Mon, 27 Feb 2023 16:37:48 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 90m
memory: 180Mi
Liveness: tcp-socket :10250 delay=300s timeout=5s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
k10-k10-token-gv9w9:
Type: Secret (a volume populated by a Secret)
SecretName: k10-k10-token-gv9w9
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 2m56s (x698 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Name: auth-svc-6654c696b8-95nj7
Namespace: kasten-io
Priority: 0
Node: znlapcdp07442v/10.147.155.146
Start Time: Mon, 27 Feb 2023 16:37:44 +0000
Labels: app=k10
app.kubernetes.io/instance=k10
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=k10
component=auth
helm.sh/chart=k10-5.5.4
heritage=Helm
pod-template-hash=6654c696b8
release=k10
run=auth-svc
Annotations: checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
cni.projectcalico.org/containerID: 163084746f5ef296fb1fe345f14705a7e20145326c9cf35779307c95cd8bc298
cni.projectcalico.org/podIP: 192.168.176.220/32
cni.projectcalico.org/podIPs: 192.168.176.220/32
Status: Running
IP: 192.168.176.220
IPs:
IP: 192.168.176.220
Controlled By: ReplicaSet/auth-svc-6654c696b8
Containers:
auth-svc:
Container ID: docker://bd6af432a08e1a35b8fb3d2710f6f9053691c1b0fe925a5c0c5e46a9dcc7c500
Image: gcr.io/kasten-images/auth:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/auth@sha256:c7993a72f8280bf8bc381d78e8bede61c05dd8fe31ed4397db5520e0bb685db7
Port: 8000/TCP
Host Port: 0/TCP
State: Running
Started: Mon, 27 Feb 2023 16:37:48 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 2m
memory: 30Mi
Liveness: http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
k10-k10-token-gv9w9:
Type: Secret (a volume populated by a Secret)
SecretName: k10-k10-token-gv9w9
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 3m36s (x694 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Name: catalog-svc-564cb97c68-qp59z
Namespace: kasten-io
Priority: 0
Node: znlapcdp07442v/10.147.155.146
Start Time: Mon, 27 Feb 2023 16:46:29 +0000
Labels: app=k10
app.kubernetes.io/instance=k10
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=k10
component=catalog
helm.sh/chart=k10-5.5.4
heritage=Helm
pod-template-hash=564cb97c68
release=k10
run=catalog-svc
Annotations: checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
cni.projectcalico.org/containerID: 18fd4970d4fcf230cee5177a95937eba2d02b04df39edfa34aa26482f0dc8685
cni.projectcalico.org/podIP: 192.168.176.195/32
cni.projectcalico.org/podIPs: 192.168.176.195/32
Status: Running
IP: 192.168.176.195
IPs:
IP: 192.168.176.195
Controlled By: ReplicaSet/catalog-svc-564cb97c68
Init Containers:
upgrade-init:
Container ID: docker://a0214d90b0b5af3879483adfe6fbcab04f8b8c03313d14563128a55024021f8e
Image: gcr.io/kasten-images/upgrade:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/upgrade@sha256:d60f32a1e219f24241568c8fe02b7a6ff74e035f9022e62e99cba72f49cef7e3
Port: <none>
Host Port: <none>
State: Terminated
Reason: Completed
Exit Code: 0
Started: Mon, 27 Feb 2023 16:46:35 +0000
Finished: Mon, 27 Feb 2023 16:46:35 +0000
Ready: True
Restart Count: 0
Environment:
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
Mounts:
/mnt/k10state from catalog-persistent-storage (rw)
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
schema-upgrade-check:
Container ID: docker://96182bab39ca1888f76403a799935a290426952f3367f7de9667590e28ecaf73
Image: gcr.io/kasten-images/catalog:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/catalog@sha256:ed5be896934d5488f95e6e0ce73ab7c91bc64c5b0342c787d669741b972dc61d
Port: <none>
Host Port: <none>
State: Terminated
Reason: Completed
Exit Code: 0
Started: Mon, 27 Feb 2023 16:46:37 +0000
Finished: Mon, 27 Feb 2023 16:46:37 +0000
Ready: True
Restart Count: 0
Environment:
INIT_CONTAINER: true
K10_RELEASE_NAME: k10
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
Mounts:
/mnt/k10state from catalog-persistent-storage (rw)
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Containers:
catalog-svc:
Container ID: docker://bf292a3a32df559b8d1080880162999b4a970f9c953cdd85572ed3008caf49b7
Image: gcr.io/kasten-images/catalog:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/catalog@sha256:ed5be896934d5488f95e6e0ce73ab7c91bc64c5b0342c787d669741b972dc61d
Port: 8000/TCP
Host Port: 0/TCP
State: Running
Started: Mon, 27 Feb 2023 16:46:40 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 200m
memory: 780Mi
Liveness: http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
Mounts:
/mnt/k10state from catalog-persistent-storage (rw)
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
kanister-sidecar:
Container ID: docker://1392a7ae19ed52cdfaacc7086c94377f0d06b49289530ece99be63263c55198e
Image: ghcr.io/kanisterio/kanister-tools:0.85.0
Image ID: docker://sha256:79c6ca8c9308655d1a1202acdc105db5d456e351bb57e95292a327daa64fb6cd
Port: <none>
Host Port: <none>
State: Running
Started: Mon, 27 Feb 2023 16:46:40 +0000
Ready: True
Restart Count: 0
Limits:
cpu: 1200m
memory: 800Mi
Requests:
cpu: 100m
memory: 800Mi
Environment: <none>
Mounts:
/mnt/k10state from catalog-persistent-storage (rw)
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
catalog-persistent-storage:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: catalog-pv-claim
ReadOnly: false
k10-k10-token-gv9w9:
Type: Secret (a volume populated by a Secret)
SecretName: k10-k10-token-gv9w9
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 4m55s (x692 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Name: controllermanager-svc-69f96f59d-lhdpr
Namespace: kasten-io
Priority: 0
Node: znlapcdp07443v/10.147.155.173
Start Time: Mon, 27 Feb 2023 16:37:44 +0000
Labels: app=k10
app.kubernetes.io/instance=k10
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=k10
component=controllermanager
helm.sh/chart=k10-5.5.4
heritage=Helm
pod-template-hash=69f96f59d
release=k10
run=controllermanager-svc
Annotations: checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
cni.projectcalico.org/containerID: d0fab1f92c90a8891358e7d56c11bc422b1ebfde3b8887d219bf13e1136c65cb
cni.projectcalico.org/podIP: 192.168.47.6/32
cni.projectcalico.org/podIPs: 192.168.47.6/32
Status: Running
IP: 192.168.47.6
IPs:
IP: 192.168.47.6
Controlled By: ReplicaSet/controllermanager-svc-69f96f59d
Containers:
controllermanager-svc:
Container ID: docker://effe8adce5996436b5af7271e8decc56aac25c995e06909920aa0bde87bfc5d8
Image: gcr.io/kasten-images/controllermanager:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/controllermanager@sha256:ab5d424c4abb456f252dcdbf206fd805c6691049f98797482a3f4fff01ba802a
Port: 8000/TCP
Host Port: 0/TCP
State: Running
Started: Mon, 27 Feb 2023 16:37:51 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 5m
memory: 30Mi
Liveness: http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
K10_STATEFUL: true
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
K10_PROMETHEUS_HOST: prometheus-server-exp
K10_PROMETHEUS_PORT: 80
K10_PROMETHEUS_BASE_URL: /k10/prometheus/
K10_GRAFANA_ENABLED: true
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
k10-k10-token-gv9w9:
Type: Secret (a volume populated by a Secret)
SecretName: k10-k10-token-gv9w9
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 2m54s (x700 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Name: crypto-svc-56dd567c79-x96g8
Namespace: kasten-io
Priority: 0
Node: znlapcdp07443v/10.147.155.173
Start Time: Mon, 27 Feb 2023 16:37:46 +0000
Labels: app=k10
app.kubernetes.io/instance=k10
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=k10
component=crypto
helm.sh/chart=k10-5.5.4
heritage=Helm
pod-template-hash=56dd567c79
release=k10
run=crypto-svc
Annotations: checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
cni.projectcalico.org/containerID: 6298ab6099930bbeff6be00767d01bb234d62acfc8ae1ed77460a82174d2c41b
cni.projectcalico.org/podIP: 192.168.47.51/32
cni.projectcalico.org/podIPs: 192.168.47.51/32
Status: Running
IP: 192.168.47.51
IPs:
IP: 192.168.47.51
Controlled By: ReplicaSet/crypto-svc-56dd567c79
Containers:
crypto-svc:
Container ID: docker://7303a674486da24303e3d138b8a600d8ed8c475eadefb622e93677e1b9e73dd5
Image: gcr.io/kasten-images/crypto:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/crypto@sha256:a2f8b52198ea94471dbe212c55a5608320bd70710aa5d643e2270f102df67835
Port: 8000/TCP
Host Port: 0/TCP
State: Running
Started: Mon, 27 Feb 2023 16:37:56 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 1m
memory: 30Mi
Liveness: http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
garbagecollector-svc:
Container ID: docker://89c6fae5c7ae92ee4cbc7f6d94d94c01b7f8928e5a85cb0da2e2a140a88141e6
Image: gcr.io/kasten-images/garbagecollector:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/garbagecollector@sha256:b687d928d27623fcac62695872ce71ab443020e2c6ee18a2f4d8fdbc2f3246b8
Port: 8003/TCP
Host Port: 0/TCP
Args:
--port=8003
--host=0.0.0.0
State: Running
Started: Mon, 27 Feb 2023 16:37:58 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 3m
memory: 100Mi
Liveness: http-get http://:8003/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8003/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_GC_DAEMON_PERIOD: <set to the key 'K10GCDaemonPeriod' of config map 'k10-config'> Optional: false
K10_GC_KEEP_MAX_ACTIONS: <set to the key 'K10GCKeepMaxActions' of config map 'k10-config'> Optional: false
K10_GC_IMPORT_RUN_ACTIONS_ENABLED: <set to the key 'K10GCImportRunActionsEnabled' of config map 'k10-config'> Optional: false
K10_GC_RETIRE_ACTIONS_ENABLED: <set to the key 'K10GCRetireActionsEnabled' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
bloblifecyclemanager-svc:
Container ID: docker://9dfda87d71a705db8ef5065e8f7e96f75545c4dcae45ebcc0907391625eadfa9
Image: gcr.io/kasten-images/bloblifecyclemanager:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/bloblifecyclemanager@sha256:695f25bd0c64f082189dceaed11351431e13dc98142bf7f94fc2b328766b525b
Port: 8001/TCP
Host Port: 0/TCP
Args:
--port=8001
--host=0.0.0.0
State: Running
Started: Mon, 27 Feb 2023 16:37:59 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 10m
memory: 40Mi
Liveness: http-get http://:8001/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8001/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
events-svc:
Container ID: docker://48fbc76e2621ed7c5e3b9863353fb0d347f2bd7eaeec217aac2185fe5ed08c3c
Image: gcr.io/kasten-images/events:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/events@sha256:949fb58a3861d6e0ed2c19ce595ce916ad5f335cb0a2596d1d1e1ad38eee980e
Port: 8002/TCP
Host Port: 0/TCP
Args:
--port=8002
--host=0.0.0.0
State: Running
Started: Mon, 27 Feb 2023 16:38:01 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 3m
memory: 500Mi
Liveness: http-get http://:8002/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8002/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
k10-k10-token-gv9w9:
Type: Secret (a volume populated by a Secret)
SecretName: k10-k10-token-gv9w9
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 3m1s (x694 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Name: dashboardbff-svc-5d47d4695f-qj64m
Namespace: kasten-io
Priority: 0
Node: znlapcdp07443v/10.147.155.173
Start Time: Mon, 27 Feb 2023 16:37:45 +0000
Labels: app=k10
app.kubernetes.io/instance=k10
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=k10
component=dashboardbff
helm.sh/chart=k10-5.5.4
heritage=Helm
pod-template-hash=5d47d4695f
release=k10
run=dashboardbff-svc
Annotations: checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
cni.projectcalico.org/containerID: 0c7bc1dc80ed90375abba7e029e6cfda8e33dbbcf8c21da3427c0819db303b74
cni.projectcalico.org/podIP: 192.168.47.16/32
cni.projectcalico.org/podIPs: 192.168.47.16/32
Status: Running
IP: 192.168.47.16
IPs:
IP: 192.168.47.16
Controlled By: ReplicaSet/dashboardbff-svc-5d47d4695f
Containers:
dashboardbff-svc:
Container ID: docker://3b8d5278bac690848517d90d50988cef9038614d8d8f150d1f02903bc0601ccf
Image: gcr.io/kasten-images/dashboardbff:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/dashboardbff@sha256:e58b9876f3d0a0ef0c3a9f24bdd89b0932268d462afb523e90e23fccbfea37a6
Port: 8000/TCP
Host Port: 0/TCP
State: Running
Started: Mon, 27 Feb 2023 16:37:53 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 8m
memory: 40Mi
Liveness: http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
K10_PROMETHEUS_HOST: prometheus-server-exp
K10_PROMETHEUS_PORT: 80
K10_PROMETHEUS_BASE_URL: /k10/prometheus/
K10_GRAFANA_ENABLED: true
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
vbrintegrationapi-svc:
Container ID: docker://4cd8b66cffd6384813f9b1f5e26ab8f48530dc1be5ca9d2b4f7eb3acb9f98396
Image: gcr.io/kasten-images/vbrintegrationapi:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/vbrintegrationapi@sha256:9cdb065a70a0f653aed296b136bc45eb33bb5f6786378d1ee45962ec75be9457
Port: 8001/TCP
Host Port: 0/TCP
Args:
--port=8001
--host=0.0.0.0
State: Running
Started: Mon, 27 Feb 2023 16:37:56 +0000
Ready: True
Restart Count: 0
Liveness: http-get http://:8001/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8001/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
k10-k10-token-gv9w9:
Type: Secret (a volume populated by a Secret)
SecretName: k10-k10-token-gv9w9
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 3m33s (x698 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Name: executor-svc-5f65d66b98-cbglk
Namespace: kasten-io
Priority: 0
Node: znlapcdp07441v/10.147.155.96
Start Time: Mon, 27 Feb 2023 16:37:46 +0000
Labels: app=k10
app.kubernetes.io/instance=k10
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=k10
component=executor
helm.sh/chart=k10-5.5.4
heritage=Helm
pod-template-hash=5f65d66b98
release=k10
run=executor-svc
Annotations: checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
cni.projectcalico.org/containerID: 8629d2bf5d5040222cd57a6667629bfb5fa46c9a19a41a1fbbdd8112ae086865
cni.projectcalico.org/podIP: 192.168.53.53/32
cni.projectcalico.org/podIPs: 192.168.53.53/32
Status: Running
IP: 192.168.53.53
IPs:
IP: 192.168.53.53
Controlled By: ReplicaSet/executor-svc-5f65d66b98
Containers:
executor-svc:
Container ID: docker://4283cf850962e9f450bf6e87d30b5462f00247f424a30fa0cd679c35e02cdb4f
Image: gcr.io/kasten-images/executor:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/executor@sha256:7c33a3c2bae717c24597d06b4c5809de12a3e4c722c86c05ed6ec3a5a596e8aa
Port: 8000/TCP
Host Port: 0/TCP
State: Running
Started: Mon, 27 Feb 2023 16:37:49 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 3m
memory: 50Mi
Liveness: http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
KUBEVIRT_VM_UNFREEZE_TIMEOUT: <set to the key 'kubeVirtVMsUnFreezeTimeout' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
DATA_MOVER_IMAGE: gcr.io/kasten-images/datamover:5.5.4
KANISTER_POD_READY_WAIT_TIMEOUT: <set to the key 'KanisterPodReadyWaitTimeout' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_EXECUTOR_WORKER_COUNT: <set to the key 'K10ExecutorWorkerCount' of config map 'k10-config'> Optional: false
K10_EXECUTOR_MAX_CONCURRENT_RESTORE_CSI_SNAPSHOTS: <set to the key 'K10ExecutorMaxConcurrentRestoreCsiSnapshots' of config map 'k10-config'> Optional: false
K10_EXECUTOR_MAX_CONCURRENT_RESTORE_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10ExecutorMaxConcurrentRestoreGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_EXECUTOR_MAX_CONCURRENT_RESTORE_WORKLOADS: <set to the key 'K10ExecutorMaxConcurrentRestoreWorkloads' of config map 'k10-config'> Optional: false
KANISTER_BACKUP_TIMEOUT: <set to the key 'KanisterBackupTimeout' of config map 'k10-config'> Optional: false
KANISTER_RESTORE_TIMEOUT: <set to the key 'KanisterRestoreTimeout' of config map 'k10-config'> Optional: false
KANISTER_DELETE_TIMEOUT: <set to the key 'KanisterDeleteTimeout' of config map 'k10-config'> Optional: false
KANISTER_HOOK_TIMEOUT: <set to the key 'KanisterHookTimeout' of config map 'k10-config'> Optional: false
KANISTER_CHECKREPO_TIMEOUT: <set to the key 'KanisterCheckRepoTimeout' of config map 'k10-config'> Optional: false
KANISTER_STATS_TIMEOUT: <set to the key 'KanisterStatsTimeout' of config map 'k10-config'> Optional: false
KANISTER_EFSPOSTRESTORE_TIMEOUT: <set to the key 'KanisterEFSPostRestoreTimeout' of config map 'k10-config'> Optional: false
EFS_BACKUP_VAULT_NAME: <set to the key 'efsBackupVaultName' of config map 'k10-config'> Optional: false
VMWARE_GOM_TIMEOUT_MIN: <set to the key 'vmWareTaskTimeoutMin' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
K10_PROMETHEUS_HOST: prometheus-server-exp
K10_PROMETHEUS_PORT: 80
K10_PROMETHEUS_BASE_URL: /k10/prometheus/
K10_GRAFANA_ENABLED: true
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
tools:
Container ID: docker://1068cf466ab3f9a7d438766500cd8b58a3d479097eab271f6bad21647c9e899a
Image: gcr.io/kasten-images/cephtool:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/cephtool@sha256:393820e485a95b96c227a7718aa7a848f8a86a7e47e7452004de85912773e49b
Port: <none>
Host Port: <none>
State: Running
Started: Mon, 27 Feb 2023 16:37:50 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 1m
memory: 2Mi
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
k10-k10-token-gv9w9:
Type: Secret (a volume populated by a Secret)
SecretName: k10-k10-token-gv9w9
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 3m26s (x694 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Name: executor-svc-5f65d66b98-jrxlm
Namespace: kasten-io
Priority: 0
Node: znlapcdp07443v/10.147.155.173
Start Time: Mon, 27 Feb 2023 16:37:46 +0000
Labels: app=k10
app.kubernetes.io/instance=k10
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=k10
component=executor
helm.sh/chart=k10-5.5.4
heritage=Helm
pod-template-hash=5f65d66b98
release=k10
run=executor-svc
Annotations: checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
cni.projectcalico.org/containerID: a328c50d8e419fa90a82695046ff192bdf9cd92f5a59b4854b30af98952128cc
cni.projectcalico.org/podIP: 192.168.47.50/32
cni.projectcalico.org/podIPs: 192.168.47.50/32
Status: Running
IP: 192.168.47.50
IPs:
IP: 192.168.47.50
Controlled By: ReplicaSet/executor-svc-5f65d66b98
Containers:
executor-svc:
Container ID: docker://54ba8d2f8adb9a34f0ea3e93163e0e39bc665d39eb63e2acfa4e2503458debba
Image: gcr.io/kasten-images/executor:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/executor@sha256:7c33a3c2bae717c24597d06b4c5809de12a3e4c722c86c05ed6ec3a5a596e8aa
Port: 8000/TCP
Host Port: 0/TCP
State: Running
Started: Mon, 27 Feb 2023 16:37:55 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 3m
memory: 50Mi
Liveness: http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
KUBEVIRT_VM_UNFREEZE_TIMEOUT: <set to the key 'kubeVirtVMsUnFreezeTimeout' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
DATA_MOVER_IMAGE: gcr.io/kasten-images/datamover:5.5.4
KANISTER_POD_READY_WAIT_TIMEOUT: <set to the key 'KanisterPodReadyWaitTimeout' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_EXECUTOR_WORKER_COUNT: <set to the key 'K10ExecutorWorkerCount' of config map 'k10-config'> Optional: false
K10_EXECUTOR_MAX_CONCURRENT_RESTORE_CSI_SNAPSHOTS: <set to the key 'K10ExecutorMaxConcurrentRestoreCsiSnapshots' of config map 'k10-config'> Optional: false
K10_EXECUTOR_MAX_CONCURRENT_RESTORE_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10ExecutorMaxConcurrentRestoreGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_EXECUTOR_MAX_CONCURRENT_RESTORE_WORKLOADS: <set to the key 'K10ExecutorMaxConcurrentRestoreWorkloads' of config map 'k10-config'> Optional: false
KANISTER_BACKUP_TIMEOUT: <set to the key 'KanisterBackupTimeout' of config map 'k10-config'> Optional: false
KANISTER_RESTORE_TIMEOUT: <set to the key 'KanisterRestoreTimeout' of config map 'k10-config'> Optional: false
KANISTER_DELETE_TIMEOUT: <set to the key 'KanisterDeleteTimeout' of config map 'k10-config'> Optional: false
KANISTER_HOOK_TIMEOUT: <set to the key 'KanisterHookTimeout' of config map 'k10-config'> Optional: false
KANISTER_CHECKREPO_TIMEOUT: <set to the key 'KanisterCheckRepoTimeout' of config map 'k10-config'> Optional: false
KANISTER_STATS_TIMEOUT: <set to the key 'KanisterStatsTimeout' of config map 'k10-config'> Optional: false
KANISTER_EFSPOSTRESTORE_TIMEOUT: <set to the key 'KanisterEFSPostRestoreTimeout' of config map 'k10-config'> Optional: false
EFS_BACKUP_VAULT_NAME: <set to the key 'efsBackupVaultName' of config map 'k10-config'> Optional: false
VMWARE_GOM_TIMEOUT_MIN: <set to the key 'vmWareTaskTimeoutMin' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
K10_PROMETHEUS_HOST: prometheus-server-exp
K10_PROMETHEUS_PORT: 80
K10_PROMETHEUS_BASE_URL: /k10/prometheus/
K10_GRAFANA_ENABLED: true
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
tools:
Container ID: docker://2cc20d51519a6d228e184887f37f0fbab152a11f2b9db8050fc69a84c9dd3515
Image: gcr.io/kasten-images/cephtool:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/cephtool@sha256:393820e485a95b96c227a7718aa7a848f8a86a7e47e7452004de85912773e49b
Port: <none>
Host Port: <none>
State: Running
Started: Mon, 27 Feb 2023 16:37:57 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 1m
memory: 2Mi
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
k10-k10-token-gv9w9:
Type: Secret (a volume populated by a Secret)
SecretName: k10-k10-token-gv9w9
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 2m51s (x695 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Name: frontend-svc-869d477cdf-w58ww
Namespace: kasten-io
Priority: 0
Node: znlapcdp07443v/10.147.155.173
Start Time: Mon, 27 Feb 2023 16:37:44 +0000
Labels: app=k10
app.kubernetes.io/instance=k10
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=k10
component=frontend
helm.sh/chart=k10-5.5.4
heritage=Helm
pod-template-hash=869d477cdf
release=k10
run=frontend-svc
Annotations: checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
cni.projectcalico.org/containerID: 876482ed0cdc67b2c7d7f2a2b2c3580e6c93fb1a31ff9d66a8fb1de8eea65529
cni.projectcalico.org/podIP: 192.168.47.7/32
cni.projectcalico.org/podIPs: 192.168.47.7/32
Status: Running
IP: 192.168.47.7
IPs:
IP: 192.168.47.7
Controlled By: ReplicaSet/frontend-svc-869d477cdf
Containers:
frontend-svc:
Container ID: docker://6082835aef3171f7d8d433e4e1dc43553a08b7ab2777f0cb57b93a8c5f968a17
Image: gcr.io/kasten-images/frontend:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/frontend@sha256:44b88219167ddde2e106e15fa798e291e03f1631e8e216d522f23fb1909d92bc
Port: 8000/TCP
Host Port: 0/TCP
State: Running
Started: Mon, 27 Feb 2023 16:37:53 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 1m
memory: 40Mi
Liveness: http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
Mounts:
/etc/nginx/conf.d/frontend.conf from frontend-config (ro,path="frontend.conf")
/etc/nginx/nginx.conf from frontend-config (ro,path="nginx.conf")
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
frontend-config:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: frontend-config
Optional: false
k10-k10-token-gv9w9:
Type: Secret (a volume populated by a Secret)
SecretName: k10-k10-token-gv9w9
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 2m58s (x696 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Name: gateway-d8bdbbccf-t799v
Namespace: kasten-io
Priority: 0
Node: znlapcdp07443v/10.147.155.173
Start Time: Mon, 27 Feb 2023 16:37:44 +0000
Labels: app=k10
app.kubernetes.io/instance=k10
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=k10
component=gateway
helm.sh/chart=k10-5.5.4
heritage=Helm
pod-template-hash=d8bdbbccf
release=k10
service=gateway
Annotations: checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
cni.projectcalico.org/containerID: b3a06ca7bfa34cb05bc26b651da5d7923157a1a6c7418c55c7bd8c144e189a98
cni.projectcalico.org/podIP: 192.168.47.60/32
cni.projectcalico.org/podIPs: 192.168.47.60/32
Status: Running
IP: 192.168.47.60
IPs:
IP: 192.168.47.60
Controlled By: ReplicaSet/gateway-d8bdbbccf
Containers:
ambassador:
Container ID: docker://48b83e92b3d0db0ef8b6b2830d431cdd738a2569508af0fe4d0ae242c50baf14
Image: gcr.io/kasten-images/emissary:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/emissary@sha256:23435e645e2c0bcbb51f6843f8f4e1ec297a02b8290d172e8178506a8f6fe71a
Port: <none>
Host Port: <none>
State: Running
Started: Mon, 27 Feb 2023 16:37:50 +0000
Ready: True
Restart Count: 0
Limits:
cpu: 1
memory: 1Gi
Requests:
cpu: 200m
memory: 300Mi
Liveness: http-get http://:8877/ambassador/v0/check_alive delay=30s timeout=1s period=3s #success=1 #failure=3
Readiness: http-get http://:8877/ambassador/v0/check_ready delay=30s timeout=1s period=3s #success=1 #failure=3
Environment:
AMBASSADOR_NAMESPACE: kasten-io (v1:metadata.namespace)
AMBASSADOR_SINGLE_NAMESPACE: true
AMBASSADOR_VERIFY_SSL_FALSE: false
AMBASSADOR_ID: kasten.io/k10
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
k10-k10-token-gv9w9:
Type: Secret (a volume populated by a Secret)
SecretName: k10-k10-token-gv9w9
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 3m30s (x699 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Name: jobs-svc-7cfcfc8cb4-lfb2h
Namespace: kasten-io
Priority: 0
Node: znlapcdp07442v/10.147.155.146
Start Time: Mon, 27 Feb 2023 16:48:42 +0000
Labels: app=k10
app.kubernetes.io/instance=k10
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=k10
component=jobs
helm.sh/chart=k10-5.5.4
heritage=Helm
pod-template-hash=7cfcfc8cb4
release=k10
run=jobs-svc
Annotations: checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
cni.projectcalico.org/containerID: 25f6aa1162646db28f813fde10160af673edf11cd2a2ebffa500368394c92f0c
cni.projectcalico.org/podIP: 192.168.176.254/32
cni.projectcalico.org/podIPs: 192.168.176.254/32
Status: Running
IP: 192.168.176.254
IPs:
IP: 192.168.176.254
Controlled By: ReplicaSet/jobs-svc-7cfcfc8cb4
Init Containers:
upgrade-init:
Container ID: docker://a57453c7c337c5442b13a7d7ba7e3f63b21ab664944c59f565b21a6d988f11b0
Image: gcr.io/kasten-images/upgrade:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/upgrade@sha256:d60f32a1e219f24241568c8fe02b7a6ff74e035f9022e62e99cba72f49cef7e3
Port: <none>
Host Port: <none>
State: Terminated
Reason: Completed
Exit Code: 0
Started: Mon, 27 Feb 2023 16:48:44 +0000
Finished: Mon, 27 Feb 2023 16:48:44 +0000
Ready: True
Restart Count: 0
Environment:
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
Mounts:
/mnt/k10state from jobs-persistent-storage (rw)
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Containers:
jobs-svc:
Container ID: docker://5bca145ed45985089b0841a4d3f3564b0831bbc7b1f992163649f31066e52764
Image: gcr.io/kasten-images/jobs:5.5.4
Image ID: docker-pullable://gcr.io/kasten-images/jobs@sha256:64a7fefb65f78ede3a92b4d0f22adb3ee3a3647724f485224ff62781650c4e21
Port: 8000/TCP
Host Port: 0/TCP
State: Running
Started: Mon, 27 Feb 2023 16:48:51 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 30m
memory: 380Mi
Liveness: http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
Environment:
VERSION: <set to the key 'version' of config map 'k10-config'> Optional: false
MODEL_STORE_DIR: <set to the key 'modelstoredirname' of config map 'k10-config'> Optional: false
LOG_LEVEL: <set to the key 'loglevel' of config map 'k10-config'> Optional: false
POD_NAMESPACE: kasten-io (v1:metadata.namespace)
CONCURRENT_SNAP_CONVERSIONS: <set to the key 'concurrentSnapConversions' of config map 'k10-config'> Optional: false
CONCURRENT_WORKLOAD_SNAPSHOTS: <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'> Optional: false
K10_DATA_STORE_PARALLEL_UPLOAD: <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'> Optional: false
K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB: <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS: <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_COPIES: <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'> Optional: false
K10_LIMITER_GENERIC_VOLUME_RESTORES: <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'> Optional: false
K10_LIMITER_CSI_SNAPSHOTS: <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'> Optional: false
K10_LIMITER_PROVIDER_SNAPSHOTS: <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'> Optional: false
AWS_ASSUME_ROLE_DURATION: <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'> Optional: false
K10_RELEASE_NAME: k10
KANISTER_FUNCTION_VERSION: <set to the key 'kanisterFunctionVersion' of config map 'k10-config'> Optional: false
Mounts:
/mnt/k10state from jobs-persistent-storage (rw)
/var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
jobs-persistent-storage:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: jobs-pv-claim
ReadOnly: false
k10-k10-token-gv9w9:
Type: Secret (a volume populated by a Secret)
SecretName: k10-k10-token-gv9w9
Optional: false
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 84s (x690 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Name: k10-grafana-bf8c67959-kxpzb
Namespace: kasten-io
Priority: 0
Node: znlapcdp07443v/10.147.155.173
Start Time: Mon, 27 Feb 2023 16:54:08 +0000
Labels: app=grafana
component=grafana
pod-template-hash=bf8c67959
release=k10
Annotations: checksum/config: 0d520b80404b43fe4bd21c306c6272741b865eb1fa10c69d2b78197dec7ffa59
checksum/dashboards-json-config: b1d3a8c25f5fc2d516af2914ecc796b6e451627e352234c80fa81cc422f2c372
checksum/sc-dashboard-provider-config: 01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b
checksum/secret: 388d6c72f3953892f8d5365899a0aa8b323b7cb4766ff1098a6519d90a284c28
cni.projectcalico.org/containerID: bf2c8fa849318231278b70cc373d41e307334060f981ca12877c1f7c36c24ebc
cni.projectcalico.org/podIP: 192.168.47.18/32
cni.projectcalico.org/podIPs: 192.168.47.18/32
Status: Running
IP: 192.168.47.18
IPs:
IP: 192.168.47.18
Controlled By: ReplicaSet/k10-grafana-bf8c67959
Init Containers:
init-chown-data:
Container ID: docker://362c5474ca88b5bffe23e029f0275b971dfe6608ecf0296f2f2fc4e14932838f
Image: registry.access.redhat.com/ubi9/ubi-minimal:9.1.0-1656.1669627757
Image ID: docker-pullable://registry.access.redhat.com/ubi9/ubi-minimal@sha256:3685c58885771d2ea14608caeab6a4c3949b973588c29ce91f462b486ee1be25
Port: <none>
Host Port: <none>
Command:
chown
-R
472:472
/var/lib/grafana
State: Terminated
Reason: Completed
Exit Code: 0
Started: Mon, 27 Feb 2023 16:54:10 +0000
Finished: Mon, 27 Feb 2023 16:54:10 +0000
Ready: True
Restart Count: 0
Environment: <none>
Mounts:
/var/lib/grafana from storage (rw)
/var/run/secrets/kubernetes.io/serviceaccount from k10-grafana-token-n8b5h (ro)
download-dashboards:
Container ID: docker://bcf05939a66ebf00a99d6751c20424dd28ed4d414582dc7935e5749b9501574f
Image: registry.access.redhat.com/ubi9/ubi-minimal:9.1.0-1656.1669627757
Image ID: docker-pullable://registry.access.redhat.com/ubi9/ubi-minimal@sha256:3685c58885771d2ea14608caeab6a4c3949b973588c29ce91f462b486ee1be25
Port: <none>
Host Port: <none>
Command:
/bin/sh
Args:
-c
mkdir -p /var/lib/grafana/dashboards/default && /bin/sh -x /etc/grafana/download_dashboards.sh
State: Terminated
Reason: Completed
Exit Code: 0
Started: Mon, 27 Feb 2023 16:54:12 +0000
Finished: Mon, 27 Feb 2023 16:54:12 +0000
Ready: True
Restart Count: 0
Environment: <none>
Mounts:
/etc/grafana/download_dashboards.sh from config (rw,path="download_dashboards.sh")
/var/lib/grafana from storage (rw)
/var/run/secrets/kubernetes.io/serviceaccount from k10-grafana-token-n8b5h (ro)
Containers:
grafana:
Container ID: docker://f2fedd588d7a1deb6d0ae430183365e34d82bcbd8177c1f957a86339f212bc1b
Image: grafana/grafana:9.1.5
Image ID: docker-pullable://grafana/grafana@sha256:05f1ea7c4b6aef700e007e42f86380d28263cde027f4e950220aa1ba661fb01b
Ports: 80/TCP, 3000/TCP
Host Ports: 0/TCP, 0/TCP
State: Running
Started: Mon, 27 Feb 2023 16:54:14 +0000
Ready: True
Restart Count: 0
Liveness: http-get http://:3000/api/health delay=60s timeout=30s period=10s #success=1 #failure=10
Readiness: http-get http://:3000/api/health delay=0s timeout=1s period=10s #success=1 #failure=3
Environment:
GF_SECURITY_ADMIN_USER: <set to the key 'admin-user' in secret 'k10-grafana'> Optional: false
GF_SECURITY_ADMIN_PASSWORD: <set to the key 'admin-password' in secret 'k10-grafana'> Optional: false
GF_PATHS_DATA: /var/lib/grafana/
GF_PATHS_LOGS: /var/log/grafana
GF_PATHS_PLUGINS: /var/lib/grafana/plugins
GF_PATHS_PROVISIONING: /etc/grafana/provisioning
Mounts:
/etc/grafana/grafana.ini from config (rw,path="grafana.ini")
/etc/grafana/provisioning/dashboards/dashboardproviders.yaml from config (rw,path="dashboardproviders.yaml")
/etc/grafana/provisioning/datasources/datasources.yaml from config (rw,path="datasources.yaml")
/var/lib/grafana from storage (rw)
/var/lib/grafana/dashboards/default/default.json from dashboards-default (rw,path="default.json")
/var/run/secrets/kubernetes.io/serviceaccount from k10-grafana-token-n8b5h (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
config:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: k10-grafana
Optional: false
dashboards-default:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: k10-grafana-dashboards-default
Optional: false
storage:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: k10-grafana
ReadOnly: false
k10-grafana-token-n8b5h:
Type: Secret (a volume populated by a Secret)
SecretName: k10-grafana-token-n8b5h
Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning DNSConfigForming 92s (x684 over 14h) kubelet Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

@Satish is there any way i can attach complete debug log file.

@Satish @jaiganeshjk can i get any help still i am getting same error.

Thanks,

Neha

Hi Neha,

For immediate assistance, I would suggest you to open a case with us by logging into my.veeam.com and selecting the product Veeam Kasten by K10 Trial.

You can upload the entire log bundle to the case.

Comment

Sign up

Login to the community

Scanning file for viruses.

This file cannot be downloaded