Question

Not able to create snapshot all pod are running.


Userlevel 3

Hi Team, 

My all pod is running but still i am not able to create snapshot.

 

when i am clicking yes continue i am getting below error:

kubectl logs dashboardbff-svc-5d47d4695f-qj64m -c dashboardbff-svc -n kasten-io

 

 


15 comments

Userlevel 3
Badge +1

Hi @ntiwari38 

Can you get the output for following? or attach the debug logs ?

kubectl get apiservices |grep -i kasten

 

From the 1st screenshot , I see the prometheus pod is not scheduled where in your 3rd screenshot you are seeing those errors . That doesn't impact your K10 Backup services. 

Regards
Satish

Userlevel 7
Badge +7

@jaiganeshjk 

Userlevel 6
Badge +2

@ntiwari38 In addition to what Satish had asked, Can you confirm if the useraccount that you are using to access K10 UI, is a K10-admin/Cluster-admin user ?

Or is it just a namespace admin or a basic user with access to few namespace ?

The RunOnce action is an admin action and can only be done by a user with cluster-admin privilege or at-least with the privilege to create runaction resource(which is a cluster-scoped resource at the moment)

Userlevel 3

@Satish Thanks for reply.

Please find the below screenshot.

 

Userlevel 3
Badge +1

Hi @ntiwari38 ,

Thanks for the output . 
apiservices looks good . 
 

looking into debug logs will help identifying the issue .

in UI -> Settings -> Support - download logs . 
 

As Jai stated , is the user account used is cluster admin or  restricted to specific namespaces ? 

Userlevel 3

@Satish 

this account is for cluster admin

Please find the debug log

Userlevel 3

http://C:\Users\ntiwari38\Downloads\k10logs.zip\k10logs

Userlevel 3

# K10: Describing K10 pods
kubectl --namespace ${k10_ns} describe pods
Name:         aggregatedapis-svc-867c46b459-s25d5
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07442v/10.147.155.146
Start Time:   Mon, 27 Feb 2023 16:37:44 +0000
Labels:       app=k10
              app.kubernetes.io/instance=k10
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=k10
              component=aggregatedapis
              helm.sh/chart=k10-5.5.4
              heritage=Helm
              pod-template-hash=867c46b459
              release=k10
              run=aggregatedapis-svc
Annotations:  checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
              checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
              checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
              cni.projectcalico.org/containerID: 94d1f6c4930773626247fc8a455cc54b5a3396a330c70d54bef7e5c61600c788
              cni.projectcalico.org/podIP: 192.168.176.238/32
              cni.projectcalico.org/podIPs: 192.168.176.238/32
Status:       Running
IP:           192.168.176.238
IPs:
  IP:           192.168.176.238
Controlled By:  ReplicaSet/aggregatedapis-svc-867c46b459
Containers:
  aggregatedapis-svc:
    Container ID:  docker://ba86cf6b4484e58ba5e7ee5acb16d365a5dd5a3f59b04dcd86c945f5aee84ca8
    Image:         gcr.io/kasten-images/aggregatedapis:5.5.4
    Image ID:      docker-pullable://gcr.io/kasten-images/aggregatedapis@sha256:d417354a3d460f2e380cbc700c593f5f30b135303fb97e7fdd1ca7da3c6d3b3c
    Port:          10250/TCP
    Host Port:     0/TCP
    Args:
      --secure-port=10250
      --cert-dir=/tmp/apiserver.local.config/certificates/
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:48 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:     90m
      memory:  180Mi
    Liveness:  tcp-socket :10250 delay=300s timeout=5s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>            Optional: false
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  k10-k10-token-gv9w9:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-k10-token-gv9w9
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                    From     Message
  ----     ------            ----                   ----     -------
  Warning  DNSConfigForming  2m56s (x698 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com


Name:         auth-svc-6654c696b8-95nj7
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07442v/10.147.155.146
Start Time:   Mon, 27 Feb 2023 16:37:44 +0000
Labels:       app=k10
              app.kubernetes.io/instance=k10
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=k10
              component=auth
              helm.sh/chart=k10-5.5.4
              heritage=Helm
              pod-template-hash=6654c696b8
              release=k10
              run=auth-svc
Annotations:  checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
              checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
              checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
              cni.projectcalico.org/containerID: 163084746f5ef296fb1fe345f14705a7e20145326c9cf35779307c95cd8bc298
              cni.projectcalico.org/podIP: 192.168.176.220/32
              cni.projectcalico.org/podIPs: 192.168.176.220/32
Status:       Running
IP:           192.168.176.220
IPs:
  IP:           192.168.176.220
Controlled By:  ReplicaSet/auth-svc-6654c696b8
Containers:
  auth-svc:
    Container ID:   docker://bd6af432a08e1a35b8fb3d2710f6f9053691c1b0fe925a5c0c5e46a9dcc7c500
    Image:          gcr.io/kasten-images/auth:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/auth@sha256:c7993a72f8280bf8bc381d78e8bede61c05dd8fe31ed4397db5520e0bb685db7
    Port:           8000/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:48 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      2m
      memory:   30Mi
    Liveness:   http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>            Optional: false
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  k10-k10-token-gv9w9:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-k10-token-gv9w9
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                    From     Message
  ----     ------            ----                   ----     -------
  Warning  DNSConfigForming  3m36s (x694 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com


Name:         catalog-svc-564cb97c68-qp59z
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07442v/10.147.155.146
Start Time:   Mon, 27 Feb 2023 16:46:29 +0000
Labels:       app=k10
              app.kubernetes.io/instance=k10
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=k10
              component=catalog
              helm.sh/chart=k10-5.5.4
              heritage=Helm
              pod-template-hash=564cb97c68
              release=k10
              run=catalog-svc
Annotations:  checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
              checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
              checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
              cni.projectcalico.org/containerID: 18fd4970d4fcf230cee5177a95937eba2d02b04df39edfa34aa26482f0dc8685
              cni.projectcalico.org/podIP: 192.168.176.195/32
              cni.projectcalico.org/podIPs: 192.168.176.195/32
Status:       Running
IP:           192.168.176.195
IPs:
  IP:           192.168.176.195
Controlled By:  ReplicaSet/catalog-svc-564cb97c68
Init Containers:
  upgrade-init:
    Container ID:   docker://a0214d90b0b5af3879483adfe6fbcab04f8b8c03313d14563128a55024021f8e
    Image:          gcr.io/kasten-images/upgrade:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/upgrade@sha256:d60f32a1e219f24241568c8fe02b7a6ff74e035f9022e62e99cba72f49cef7e3
    Port:           <none>
    Host Port:      <none>
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Mon, 27 Feb 2023 16:46:35 +0000
      Finished:     Mon, 27 Feb 2023 16:46:35 +0000
    Ready:          True
    Restart Count:  0
    Environment:
      MODEL_STORE_DIR:  <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
    Mounts:
      /mnt/k10state from catalog-persistent-storage (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
  schema-upgrade-check:
    Container ID:   docker://96182bab39ca1888f76403a799935a290426952f3367f7de9667590e28ecaf73
    Image:          gcr.io/kasten-images/catalog:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/catalog@sha256:ed5be896934d5488f95e6e0ce73ab7c91bc64c5b0342c787d669741b972dc61d
    Port:           <none>
    Host Port:      <none>
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Mon, 27 Feb 2023 16:46:37 +0000
      Finished:     Mon, 27 Feb 2023 16:46:37 +0000
    Ready:          True
    Restart Count:  0
    Environment:
      INIT_CONTAINER:    true
      K10_RELEASE_NAME:  k10
      LOG_LEVEL:         <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      MODEL_STORE_DIR:   <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      POD_NAMESPACE:     kasten-io (v1:metadata.namespace)
      VERSION:           <set to the key 'version' of config map 'k10-config'>  Optional: false
    Mounts:
      /mnt/k10state from catalog-persistent-storage (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Containers:
  catalog-svc:
    Container ID:   docker://bf292a3a32df559b8d1080880162999b4a970f9c953cdd85572ed3008caf49b7
    Image:          gcr.io/kasten-images/catalog:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/catalog@sha256:ed5be896934d5488f95e6e0ce73ab7c91bc64c5b0342c787d669741b972dc61d
    Port:           8000/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Mon, 27 Feb 2023 16:46:40 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      200m
      memory:   780Mi
    Liveness:   http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>            Optional: false
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
    Mounts:
      /mnt/k10state from catalog-persistent-storage (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
  kanister-sidecar:
    Container ID:   docker://1392a7ae19ed52cdfaacc7086c94377f0d06b49289530ece99be63263c55198e
    Image:          ghcr.io/kanisterio/kanister-tools:0.85.0
    Image ID:       docker://sha256:79c6ca8c9308655d1a1202acdc105db5d456e351bb57e95292a327daa64fb6cd
    Port:           <none>
    Host Port:      <none>
    State:          Running
      Started:      Mon, 27 Feb 2023 16:46:40 +0000
    Ready:          True
    Restart Count:  0
    Limits:
      cpu:     1200m
      memory:  800Mi
    Requests:
      cpu:        100m
      memory:     800Mi
    Environment:  <none>
    Mounts:
      /mnt/k10state from catalog-persistent-storage (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  catalog-persistent-storage:
    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
    ClaimName:  catalog-pv-claim
    ReadOnly:   false
  k10-k10-token-gv9w9:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-k10-token-gv9w9
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                    From     Message
  ----     ------            ----                   ----     -------
  Warning  DNSConfigForming  4m55s (x692 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com


Name:         controllermanager-svc-69f96f59d-lhdpr
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07443v/10.147.155.173
Start Time:   Mon, 27 Feb 2023 16:37:44 +0000
Labels:       app=k10
              app.kubernetes.io/instance=k10
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=k10
              component=controllermanager
              helm.sh/chart=k10-5.5.4
              heritage=Helm
              pod-template-hash=69f96f59d
              release=k10
              run=controllermanager-svc
Annotations:  checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
              checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
              checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
              cni.projectcalico.org/containerID: d0fab1f92c90a8891358e7d56c11bc422b1ebfde3b8887d219bf13e1136c65cb
              cni.projectcalico.org/podIP: 192.168.47.6/32
              cni.projectcalico.org/podIPs: 192.168.47.6/32
Status:       Running
IP:           192.168.47.6
IPs:
  IP:           192.168.47.6
Controlled By:  ReplicaSet/controllermanager-svc-69f96f59d
Containers:
  controllermanager-svc:
    Container ID:   docker://effe8adce5996436b5af7271e8decc56aac25c995e06909920aa0bde87bfc5d8
    Image:          gcr.io/kasten-images/controllermanager:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/controllermanager@sha256:ab5d424c4abb456f252dcdbf206fd805c6691049f98797482a3f4fff01ba802a
    Port:           8000/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:51 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      5m
      memory:   30Mi
    Liveness:   http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>  Optional: false
      K10_STATEFUL:                                   true
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
      K10_PROMETHEUS_HOST:                            prometheus-server-exp
      K10_PROMETHEUS_PORT:                            80
      K10_PROMETHEUS_BASE_URL:                        /k10/prometheus/
      K10_GRAFANA_ENABLED:                            true
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  k10-k10-token-gv9w9:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-k10-token-gv9w9
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                    From     Message
  ----     ------            ----                   ----     -------
  Warning  DNSConfigForming  2m54s (x700 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com
 

Userlevel 3

Name:         crypto-svc-56dd567c79-x96g8
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07443v/10.147.155.173
Start Time:   Mon, 27 Feb 2023 16:37:46 +0000
Labels:       app=k10
              app.kubernetes.io/instance=k10
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=k10
              component=crypto
              helm.sh/chart=k10-5.5.4
              heritage=Helm
              pod-template-hash=56dd567c79
              release=k10
              run=crypto-svc
Annotations:  checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
              checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
              checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
              cni.projectcalico.org/containerID: 6298ab6099930bbeff6be00767d01bb234d62acfc8ae1ed77460a82174d2c41b
              cni.projectcalico.org/podIP: 192.168.47.51/32
              cni.projectcalico.org/podIPs: 192.168.47.51/32
Status:       Running
IP:           192.168.47.51
IPs:
  IP:           192.168.47.51
Controlled By:  ReplicaSet/crypto-svc-56dd567c79
Containers:
  crypto-svc:
    Container ID:   docker://7303a674486da24303e3d138b8a600d8ed8c475eadefb622e93677e1b9e73dd5
    Image:          gcr.io/kasten-images/crypto:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/crypto@sha256:a2f8b52198ea94471dbe212c55a5608320bd70710aa5d643e2270f102df67835
    Port:           8000/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:56 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      1m
      memory:   30Mi
    Liveness:   http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>            Optional: false
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
  garbagecollector-svc:
    Container ID:  docker://89c6fae5c7ae92ee4cbc7f6d94d94c01b7f8928e5a85cb0da2e2a140a88141e6
    Image:         gcr.io/kasten-images/garbagecollector:5.5.4
    Image ID:      docker-pullable://gcr.io/kasten-images/garbagecollector@sha256:b687d928d27623fcac62695872ce71ab443020e2c6ee18a2f4d8fdbc2f3246b8
    Port:          8003/TCP
    Host Port:     0/TCP
    Args:
      --port=8003
      --host=0.0.0.0
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:58 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      3m
      memory:   100Mi
    Liveness:   http-get http://:8003/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8003/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>            Optional: false
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_GC_DAEMON_PERIOD:                           <set to the key 'K10GCDaemonPeriod' of config map 'k10-config'>                       Optional: false
      K10_GC_KEEP_MAX_ACTIONS:                        <set to the key 'K10GCKeepMaxActions' of config map 'k10-config'>                     Optional: false
      K10_GC_IMPORT_RUN_ACTIONS_ENABLED:              <set to the key 'K10GCImportRunActionsEnabled' of config map 'k10-config'>            Optional: false
      K10_GC_RETIRE_ACTIONS_ENABLED:                  <set to the key 'K10GCRetireActionsEnabled' of config map 'k10-config'>               Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
  bloblifecyclemanager-svc:
    Container ID:  docker://9dfda87d71a705db8ef5065e8f7e96f75545c4dcae45ebcc0907391625eadfa9
    Image:         gcr.io/kasten-images/bloblifecyclemanager:5.5.4
    Image ID:      docker-pullable://gcr.io/kasten-images/bloblifecyclemanager@sha256:695f25bd0c64f082189dceaed11351431e13dc98142bf7f94fc2b328766b525b
    Port:          8001/TCP
    Host Port:     0/TCP
    Args:
      --port=8001
      --host=0.0.0.0
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:59 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      10m
      memory:   40Mi
    Liveness:   http-get http://:8001/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8001/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>            Optional: false
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
  events-svc:
    Container ID:  docker://48fbc76e2621ed7c5e3b9863353fb0d347f2bd7eaeec217aac2185fe5ed08c3c
    Image:         gcr.io/kasten-images/events:5.5.4
    Image ID:      docker-pullable://gcr.io/kasten-images/events@sha256:949fb58a3861d6e0ed2c19ce595ce916ad5f335cb0a2596d1d1e1ad38eee980e
    Port:          8002/TCP
    Host Port:     0/TCP
    Args:
      --port=8002
      --host=0.0.0.0
    State:          Running
      Started:      Mon, 27 Feb 2023 16:38:01 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      3m
      memory:   500Mi
    Liveness:   http-get http://:8002/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8002/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>            Optional: false
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  k10-k10-token-gv9w9:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-k10-token-gv9w9
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                   From     Message
  ----     ------            ----                  ----     -------
  Warning  DNSConfigForming  3m1s (x694 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com


Name:         dashboardbff-svc-5d47d4695f-qj64m
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07443v/10.147.155.173
Start Time:   Mon, 27 Feb 2023 16:37:45 +0000
Labels:       app=k10
              app.kubernetes.io/instance=k10
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=k10
              component=dashboardbff
              helm.sh/chart=k10-5.5.4
              heritage=Helm
              pod-template-hash=5d47d4695f
              release=k10
              run=dashboardbff-svc
Annotations:  checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
              checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
              checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
              cni.projectcalico.org/containerID: 0c7bc1dc80ed90375abba7e029e6cfda8e33dbbcf8c21da3427c0819db303b74
              cni.projectcalico.org/podIP: 192.168.47.16/32
              cni.projectcalico.org/podIPs: 192.168.47.16/32
Status:       Running
IP:           192.168.47.16
IPs:
  IP:           192.168.47.16
Controlled By:  ReplicaSet/dashboardbff-svc-5d47d4695f
Containers:
  dashboardbff-svc:
    Container ID:   docker://3b8d5278bac690848517d90d50988cef9038614d8d8f150d1f02903bc0601ccf
    Image:          gcr.io/kasten-images/dashboardbff:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/dashboardbff@sha256:e58b9876f3d0a0ef0c3a9f24bdd89b0932268d462afb523e90e23fccbfea37a6
    Port:           8000/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:53 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      8m
      memory:   40Mi
    Liveness:   http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>            Optional: false
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
      K10_PROMETHEUS_HOST:                            prometheus-server-exp
      K10_PROMETHEUS_PORT:                            80
      K10_PROMETHEUS_BASE_URL:                        /k10/prometheus/
      K10_GRAFANA_ENABLED:                            true
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
  vbrintegrationapi-svc:
    Container ID:  docker://4cd8b66cffd6384813f9b1f5e26ab8f48530dc1be5ca9d2b4f7eb3acb9f98396
    Image:         gcr.io/kasten-images/vbrintegrationapi:5.5.4
    Image ID:      docker-pullable://gcr.io/kasten-images/vbrintegrationapi@sha256:9cdb065a70a0f653aed296b136bc45eb33bb5f6786378d1ee45962ec75be9457
    Port:          8001/TCP
    Host Port:     0/TCP
    Args:
      --port=8001
      --host=0.0.0.0
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:56 +0000
    Ready:          True
    Restart Count:  0
    Liveness:       http-get http://:8001/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:      http-get http://:8001/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>            Optional: false
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  k10-k10-token-gv9w9:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-k10-token-gv9w9
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                    From     Message
  ----     ------            ----                   ----     -------
  Warning  DNSConfigForming  3m33s (x698 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com
 

Userlevel 3

Name:         executor-svc-5f65d66b98-cbglk
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07441v/10.147.155.96
Start Time:   Mon, 27 Feb 2023 16:37:46 +0000
Labels:       app=k10
              app.kubernetes.io/instance=k10
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=k10
              component=executor
              helm.sh/chart=k10-5.5.4
              heritage=Helm
              pod-template-hash=5f65d66b98
              release=k10
              run=executor-svc
Annotations:  checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
              checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
              checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
              cni.projectcalico.org/containerID: 8629d2bf5d5040222cd57a6667629bfb5fa46c9a19a41a1fbbdd8112ae086865
              cni.projectcalico.org/podIP: 192.168.53.53/32
              cni.projectcalico.org/podIPs: 192.168.53.53/32
Status:       Running
IP:           192.168.53.53
IPs:
  IP:           192.168.53.53
Controlled By:  ReplicaSet/executor-svc-5f65d66b98
Containers:
  executor-svc:
    Container ID:   docker://4283cf850962e9f450bf6e87d30b5462f00247f424a30fa0cd679c35e02cdb4f
    Image:          gcr.io/kasten-images/executor:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/executor@sha256:7c33a3c2bae717c24597d06b4c5809de12a3e4c722c86c05ed6ec3a5a596e8aa
    Port:           8000/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:49 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      3m
      memory:   50Mi
    Liveness:   http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                                       <set to the key 'version' of config map 'k10-config'>                     Optional: false
      KUBEVIRT_VM_UNFREEZE_TIMEOUT:                                  <set to the key 'kubeVirtVMsUnFreezeTimeout' of config map 'k10-config'>  Optional: false
      MODEL_STORE_DIR:                                               <set to the key 'modelstoredirname' of config map 'k10-config'>           Optional: false
      DATA_MOVER_IMAGE:                                              gcr.io/kasten-images/datamover:5.5.4
      KANISTER_POD_READY_WAIT_TIMEOUT:                               <set to the key 'KanisterPodReadyWaitTimeout' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                                     <set to the key 'loglevel' of config map 'k10-config'>                     Optional: false
      POD_NAMESPACE:                                                 kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                                   <set to the key 'concurrentSnapConversions' of config map 'k10-config'>                              Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                                 <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>                            Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                                <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>                             Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:                  <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>                  Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:                 <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>                 Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:                  <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>                  Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:                 <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>                 Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:                          <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>                       Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:                             <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>                          Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:                           <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>                        Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                                     <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                                 Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                                <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>                            Optional: false
      AWS_ASSUME_ROLE_DURATION:                                      <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                                  Optional: false
      K10_EXECUTOR_WORKER_COUNT:                                     <set to the key 'K10ExecutorWorkerCount' of config map 'k10-config'>                                 Optional: false
      K10_EXECUTOR_MAX_CONCURRENT_RESTORE_CSI_SNAPSHOTS:             <set to the key 'K10ExecutorMaxConcurrentRestoreCsiSnapshots' of config map 'k10-config'>            Optional: false
      K10_EXECUTOR_MAX_CONCURRENT_RESTORE_GENERIC_VOLUME_SNAPSHOTS:  <set to the key 'K10ExecutorMaxConcurrentRestoreGenericVolumeSnapshots' of config map 'k10-config'>  Optional: false
      K10_EXECUTOR_MAX_CONCURRENT_RESTORE_WORKLOADS:                 <set to the key 'K10ExecutorMaxConcurrentRestoreWorkloads' of config map 'k10-config'>               Optional: false
      KANISTER_BACKUP_TIMEOUT:                                       <set to the key 'KanisterBackupTimeout' of config map 'k10-config'>                                  Optional: false
      KANISTER_RESTORE_TIMEOUT:                                      <set to the key 'KanisterRestoreTimeout' of config map 'k10-config'>                                 Optional: false
      KANISTER_DELETE_TIMEOUT:                                       <set to the key 'KanisterDeleteTimeout' of config map 'k10-config'>                                  Optional: false
      KANISTER_HOOK_TIMEOUT:                                         <set to the key 'KanisterHookTimeout' of config map 'k10-config'>                                    Optional: false
      KANISTER_CHECKREPO_TIMEOUT:                                    <set to the key 'KanisterCheckRepoTimeout' of config map 'k10-config'>                               Optional: false
      KANISTER_STATS_TIMEOUT:                                        <set to the key 'KanisterStatsTimeout' of config map 'k10-config'>                                   Optional: false
      KANISTER_EFSPOSTRESTORE_TIMEOUT:                               <set to the key 'KanisterEFSPostRestoreTimeout' of config map 'k10-config'>                          Optional: false
      EFS_BACKUP_VAULT_NAME:                                         <set to the key 'efsBackupVaultName' of config map 'k10-config'>                                     Optional: false
      VMWARE_GOM_TIMEOUT_MIN:                                        <set to the key 'vmWareTaskTimeoutMin' of config map 'k10-config'>                                   Optional: false
      K10_RELEASE_NAME:                                              k10
      KANISTER_FUNCTION_VERSION:                                     <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
      K10_PROMETHEUS_HOST:                                           prometheus-server-exp
      K10_PROMETHEUS_PORT:                                           80
      K10_PROMETHEUS_BASE_URL:                                       /k10/prometheus/
      K10_GRAFANA_ENABLED:                                           true
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
  tools:
    Container ID:   docker://1068cf466ab3f9a7d438766500cd8b58a3d479097eab271f6bad21647c9e899a
    Image:          gcr.io/kasten-images/cephtool:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/cephtool@sha256:393820e485a95b96c227a7718aa7a848f8a86a7e47e7452004de85912773e49b
    Port:           <none>
    Host Port:      <none>
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:50 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:        1m
      memory:     2Mi
    Environment:  <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  k10-k10-token-gv9w9:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-k10-token-gv9w9
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                    From     Message
  ----     ------            ----                   ----     -------
  Warning  DNSConfigForming  3m26s (x694 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com


Name:         executor-svc-5f65d66b98-jrxlm
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07443v/10.147.155.173
Start Time:   Mon, 27 Feb 2023 16:37:46 +0000
Labels:       app=k10
              app.kubernetes.io/instance=k10
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=k10
              component=executor
              helm.sh/chart=k10-5.5.4
              heritage=Helm
              pod-template-hash=5f65d66b98
              release=k10
              run=executor-svc
Annotations:  checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
              checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
              checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
              cni.projectcalico.org/containerID: a328c50d8e419fa90a82695046ff192bdf9cd92f5a59b4854b30af98952128cc
              cni.projectcalico.org/podIP: 192.168.47.50/32
              cni.projectcalico.org/podIPs: 192.168.47.50/32
Status:       Running
IP:           192.168.47.50
IPs:
  IP:           192.168.47.50
Controlled By:  ReplicaSet/executor-svc-5f65d66b98
Containers:
  executor-svc:
    Container ID:   docker://54ba8d2f8adb9a34f0ea3e93163e0e39bc665d39eb63e2acfa4e2503458debba
    Image:          gcr.io/kasten-images/executor:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/executor@sha256:7c33a3c2bae717c24597d06b4c5809de12a3e4c722c86c05ed6ec3a5a596e8aa
    Port:           8000/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:55 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      3m
      memory:   50Mi
    Liveness:   http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                                       <set to the key 'version' of config map 'k10-config'>                     Optional: false
      KUBEVIRT_VM_UNFREEZE_TIMEOUT:                                  <set to the key 'kubeVirtVMsUnFreezeTimeout' of config map 'k10-config'>  Optional: false
      MODEL_STORE_DIR:                                               <set to the key 'modelstoredirname' of config map 'k10-config'>           Optional: false
      DATA_MOVER_IMAGE:                                              gcr.io/kasten-images/datamover:5.5.4
      KANISTER_POD_READY_WAIT_TIMEOUT:                               <set to the key 'KanisterPodReadyWaitTimeout' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                                     <set to the key 'loglevel' of config map 'k10-config'>                     Optional: false
      POD_NAMESPACE:                                                 kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                                   <set to the key 'concurrentSnapConversions' of config map 'k10-config'>                              Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                                 <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>                            Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                                <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>                             Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:                  <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>                  Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:                 <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>                 Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:                  <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>                  Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:                 <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>                 Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:                          <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>                       Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:                             <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>                          Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:                           <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>                        Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                                     <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                                 Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                                <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>                            Optional: false
      AWS_ASSUME_ROLE_DURATION:                                      <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                                  Optional: false
      K10_EXECUTOR_WORKER_COUNT:                                     <set to the key 'K10ExecutorWorkerCount' of config map 'k10-config'>                                 Optional: false
      K10_EXECUTOR_MAX_CONCURRENT_RESTORE_CSI_SNAPSHOTS:             <set to the key 'K10ExecutorMaxConcurrentRestoreCsiSnapshots' of config map 'k10-config'>            Optional: false
      K10_EXECUTOR_MAX_CONCURRENT_RESTORE_GENERIC_VOLUME_SNAPSHOTS:  <set to the key 'K10ExecutorMaxConcurrentRestoreGenericVolumeSnapshots' of config map 'k10-config'>  Optional: false
      K10_EXECUTOR_MAX_CONCURRENT_RESTORE_WORKLOADS:                 <set to the key 'K10ExecutorMaxConcurrentRestoreWorkloads' of config map 'k10-config'>               Optional: false
      KANISTER_BACKUP_TIMEOUT:                                       <set to the key 'KanisterBackupTimeout' of config map 'k10-config'>                                  Optional: false
      KANISTER_RESTORE_TIMEOUT:                                      <set to the key 'KanisterRestoreTimeout' of config map 'k10-config'>                                 Optional: false
      KANISTER_DELETE_TIMEOUT:                                       <set to the key 'KanisterDeleteTimeout' of config map 'k10-config'>                                  Optional: false
      KANISTER_HOOK_TIMEOUT:                                         <set to the key 'KanisterHookTimeout' of config map 'k10-config'>                                    Optional: false
      KANISTER_CHECKREPO_TIMEOUT:                                    <set to the key 'KanisterCheckRepoTimeout' of config map 'k10-config'>                               Optional: false
      KANISTER_STATS_TIMEOUT:                                        <set to the key 'KanisterStatsTimeout' of config map 'k10-config'>                                   Optional: false
      KANISTER_EFSPOSTRESTORE_TIMEOUT:                               <set to the key 'KanisterEFSPostRestoreTimeout' of config map 'k10-config'>                          Optional: false
      EFS_BACKUP_VAULT_NAME:                                         <set to the key 'efsBackupVaultName' of config map 'k10-config'>                                     Optional: false
      VMWARE_GOM_TIMEOUT_MIN:                                        <set to the key 'vmWareTaskTimeoutMin' of config map 'k10-config'>                                   Optional: false
      K10_RELEASE_NAME:                                              k10
      KANISTER_FUNCTION_VERSION:                                     <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
      K10_PROMETHEUS_HOST:                                           prometheus-server-exp
      K10_PROMETHEUS_PORT:                                           80
      K10_PROMETHEUS_BASE_URL:                                       /k10/prometheus/
      K10_GRAFANA_ENABLED:                                           true
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
  tools:
    Container ID:   docker://2cc20d51519a6d228e184887f37f0fbab152a11f2b9db8050fc69a84c9dd3515
    Image:          gcr.io/kasten-images/cephtool:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/cephtool@sha256:393820e485a95b96c227a7718aa7a848f8a86a7e47e7452004de85912773e49b
    Port:           <none>
    Host Port:      <none>
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:57 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:        1m
      memory:     2Mi
    Environment:  <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  k10-k10-token-gv9w9:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-k10-token-gv9w9
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                    From     Message
  ----     ------            ----                   ----     -------
  Warning  DNSConfigForming  2m51s (x695 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com
 

Userlevel 3

Name:         frontend-svc-869d477cdf-w58ww
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07443v/10.147.155.173
Start Time:   Mon, 27 Feb 2023 16:37:44 +0000
Labels:       app=k10
              app.kubernetes.io/instance=k10
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=k10
              component=frontend
              helm.sh/chart=k10-5.5.4
              heritage=Helm
              pod-template-hash=869d477cdf
              release=k10
              run=frontend-svc
Annotations:  checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
              checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
              checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
              cni.projectcalico.org/containerID: 876482ed0cdc67b2c7d7f2a2b2c3580e6c93fb1a31ff9d66a8fb1de8eea65529
              cni.projectcalico.org/podIP: 192.168.47.7/32
              cni.projectcalico.org/podIPs: 192.168.47.7/32
Status:       Running
IP:           192.168.47.7
IPs:
  IP:           192.168.47.7
Controlled By:  ReplicaSet/frontend-svc-869d477cdf
Containers:
  frontend-svc:
    Container ID:   docker://6082835aef3171f7d8d433e4e1dc43553a08b7ab2777f0cb57b93a8c5f968a17
    Image:          gcr.io/kasten-images/frontend:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/frontend@sha256:44b88219167ddde2e106e15fa798e291e03f1631e8e216d522f23fb1909d92bc
    Port:           8000/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:53 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      1m
      memory:   40Mi
    Liveness:   http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>            Optional: false
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
    Mounts:
      /etc/nginx/conf.d/frontend.conf from frontend-config (ro,path="frontend.conf")
      /etc/nginx/nginx.conf from frontend-config (ro,path="nginx.conf")
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  frontend-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      frontend-config
    Optional:  false
  k10-k10-token-gv9w9:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-k10-token-gv9w9
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                    From     Message
  ----     ------            ----                   ----     -------
  Warning  DNSConfigForming  2m58s (x696 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com


Name:         gateway-d8bdbbccf-t799v
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07443v/10.147.155.173
Start Time:   Mon, 27 Feb 2023 16:37:44 +0000
Labels:       app=k10
              app.kubernetes.io/instance=k10
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=k10
              component=gateway
              helm.sh/chart=k10-5.5.4
              heritage=Helm
              pod-template-hash=d8bdbbccf
              release=k10
              service=gateway
Annotations:  checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
              checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
              cni.projectcalico.org/containerID: b3a06ca7bfa34cb05bc26b651da5d7923157a1a6c7418c55c7bd8c144e189a98
              cni.projectcalico.org/podIP: 192.168.47.60/32
              cni.projectcalico.org/podIPs: 192.168.47.60/32
Status:       Running
IP:           192.168.47.60
IPs:
  IP:           192.168.47.60
Controlled By:  ReplicaSet/gateway-d8bdbbccf
Containers:
  ambassador:
    Container ID:   docker://48b83e92b3d0db0ef8b6b2830d431cdd738a2569508af0fe4d0ae242c50baf14
    Image:          gcr.io/kasten-images/emissary:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/emissary@sha256:23435e645e2c0bcbb51f6843f8f4e1ec297a02b8290d172e8178506a8f6fe71a
    Port:           <none>
    Host Port:      <none>
    State:          Running
      Started:      Mon, 27 Feb 2023 16:37:50 +0000
    Ready:          True
    Restart Count:  0
    Limits:
      cpu:     1
      memory:  1Gi
    Requests:
      cpu:      200m
      memory:   300Mi
    Liveness:   http-get http://:8877/ambassador/v0/check_alive delay=30s timeout=1s period=3s #success=1 #failure=3
    Readiness:  http-get http://:8877/ambassador/v0/check_ready delay=30s timeout=1s period=3s #success=1 #failure=3
    Environment:
      AMBASSADOR_NAMESPACE:         kasten-io (v1:metadata.namespace)
      AMBASSADOR_SINGLE_NAMESPACE:  true
      AMBASSADOR_VERIFY_SSL_FALSE:  false
      AMBASSADOR_ID:                kasten.io/k10
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  k10-k10-token-gv9w9:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-k10-token-gv9w9
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                    From     Message
  ----     ------            ----                   ----     -------
  Warning  DNSConfigForming  3m30s (x699 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com

Userlevel 3

Name:         jobs-svc-7cfcfc8cb4-lfb2h
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07442v/10.147.155.146
Start Time:   Mon, 27 Feb 2023 16:48:42 +0000
Labels:       app=k10
              app.kubernetes.io/instance=k10
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=k10
              component=jobs
              helm.sh/chart=k10-5.5.4
              heritage=Helm
              pod-template-hash=7cfcfc8cb4
              release=k10
              run=jobs-svc
Annotations:  checksum/config: de46001030612c8f2ca68ca0272bdf5013ef860e9764cee0ea9840bd882ac24f
              checksum/frontend-nginx-config: 21bf136f4dddf4bb18460ee46b053d126956645eb71847ca37b8179caaa79718
              checksum/secret: 545c38b0922de19734fbffde62792c37c2aef6a3216cfa472449173165220f7d
              cni.projectcalico.org/containerID: 25f6aa1162646db28f813fde10160af673edf11cd2a2ebffa500368394c92f0c
              cni.projectcalico.org/podIP: 192.168.176.254/32
              cni.projectcalico.org/podIPs: 192.168.176.254/32
Status:       Running
IP:           192.168.176.254
IPs:
  IP:           192.168.176.254
Controlled By:  ReplicaSet/jobs-svc-7cfcfc8cb4
Init Containers:
  upgrade-init:
    Container ID:   docker://a57453c7c337c5442b13a7d7ba7e3f63b21ab664944c59f565b21a6d988f11b0
    Image:          gcr.io/kasten-images/upgrade:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/upgrade@sha256:d60f32a1e219f24241568c8fe02b7a6ff74e035f9022e62e99cba72f49cef7e3
    Port:           <none>
    Host Port:      <none>
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Mon, 27 Feb 2023 16:48:44 +0000
      Finished:     Mon, 27 Feb 2023 16:48:44 +0000
    Ready:          True
    Restart Count:  0
    Environment:
      MODEL_STORE_DIR:  <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
    Mounts:
      /mnt/k10state from jobs-persistent-storage (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Containers:
  jobs-svc:
    Container ID:   docker://5bca145ed45985089b0841a4d3f3564b0831bbc7b1f992163649f31066e52764
    Image:          gcr.io/kasten-images/jobs:5.5.4
    Image ID:       docker-pullable://gcr.io/kasten-images/jobs@sha256:64a7fefb65f78ede3a92b4d0f22adb3ee3a3647724f485224ff62781650c4e21
    Port:           8000/TCP
    Host Port:      0/TCP
    State:          Running
      Started:      Mon, 27 Feb 2023 16:48:51 +0000
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      30m
      memory:   380Mi
    Liveness:   http-get http://:8000/v0/healthz delay=300s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:8000/v0/healthz delay=3s timeout=1s period=10s #success=1 #failure=3
    Environment:
      VERSION:                                        <set to the key 'version' of config map 'k10-config'>            Optional: false
      MODEL_STORE_DIR:                                <set to the key 'modelstoredirname' of config map 'k10-config'>  Optional: false
      LOG_LEVEL:                                      <set to the key 'loglevel' of config map 'k10-config'>           Optional: false
      POD_NAMESPACE:                                  kasten-io (v1:metadata.namespace)
      CONCURRENT_SNAP_CONVERSIONS:                    <set to the key 'concurrentSnapConversions' of config map 'k10-config'>               Optional: false
      CONCURRENT_WORKLOAD_SNAPSHOTS:                  <set to the key 'concurrentWorkloadSnapshots' of config map 'k10-config'>             Optional: false
      K10_DATA_STORE_PARALLEL_UPLOAD:                 <set to the key 'k10DataStoreParallelUpload' of config map 'k10-config'>              Optional: false
      K10_DATA_STORE_GENERAL_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreGeneralContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_GENERAL_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreGeneralMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_DATA_STORE_RESTORE_CONTENT_CACHE_SIZE_MB:   <set to the key 'k10DataStoreRestoreContentCacheSizeMB' of config map 'k10-config'>   Optional: false
      K10_DATA_STORE_RESTORE_METADATA_CACHE_SIZE_MB:  <set to the key 'k10DataStoreRestoreMetadataCacheSizeMB' of config map 'k10-config'>  Optional: false
      K10_LIMITER_GENERIC_VOLUME_SNAPSHOTS:           <set to the key 'K10LimiterGenericVolumeSnapshots' of config map 'k10-config'>        Optional: false
      K10_LIMITER_GENERIC_VOLUME_COPIES:              <set to the key 'K10LimiterGenericVolumeCopies' of config map 'k10-config'>           Optional: false
      K10_LIMITER_GENERIC_VOLUME_RESTORES:            <set to the key 'K10LimiterGenericVolumeRestores' of config map 'k10-config'>         Optional: false
      K10_LIMITER_CSI_SNAPSHOTS:                      <set to the key 'K10LimiterCsiSnapshots' of config map 'k10-config'>                  Optional: false
      K10_LIMITER_PROVIDER_SNAPSHOTS:                 <set to the key 'K10LimiterProviderSnapshots' of config map 'k10-config'>             Optional: false
      AWS_ASSUME_ROLE_DURATION:                       <set to the key 'AWSAssumeRoleDuration' of config map 'k10-config'>                   Optional: false
      K10_RELEASE_NAME:                               k10
      KANISTER_FUNCTION_VERSION:                      <set to the key 'kanisterFunctionVersion' of config map 'k10-config'>  Optional: false
    Mounts:
      /mnt/k10state from jobs-persistent-storage (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from k10-k10-token-gv9w9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  jobs-persistent-storage:
    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
    ClaimName:  jobs-pv-claim
    ReadOnly:   false
  k10-k10-token-gv9w9:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-k10-token-gv9w9
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                  From     Message
  ----     ------            ----                 ----     -------
  Warning  DNSConfigForming  84s (x690 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com


Name:         k10-grafana-bf8c67959-kxpzb
Namespace:    kasten-io
Priority:     0
Node:         znlapcdp07443v/10.147.155.173
Start Time:   Mon, 27 Feb 2023 16:54:08 +0000
Labels:       app=grafana
              component=grafana
              pod-template-hash=bf8c67959
              release=k10
Annotations:  checksum/config: 0d520b80404b43fe4bd21c306c6272741b865eb1fa10c69d2b78197dec7ffa59
              checksum/dashboards-json-config: b1d3a8c25f5fc2d516af2914ecc796b6e451627e352234c80fa81cc422f2c372
              checksum/sc-dashboard-provider-config: 01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b
              checksum/secret: 388d6c72f3953892f8d5365899a0aa8b323b7cb4766ff1098a6519d90a284c28
              cni.projectcalico.org/containerID: bf2c8fa849318231278b70cc373d41e307334060f981ca12877c1f7c36c24ebc
              cni.projectcalico.org/podIP: 192.168.47.18/32
              cni.projectcalico.org/podIPs: 192.168.47.18/32
Status:       Running
IP:           192.168.47.18
IPs:
  IP:           192.168.47.18
Controlled By:  ReplicaSet/k10-grafana-bf8c67959
Init Containers:
  init-chown-data:
    Container ID:  docker://362c5474ca88b5bffe23e029f0275b971dfe6608ecf0296f2f2fc4e14932838f
    Image:         registry.access.redhat.com/ubi9/ubi-minimal:9.1.0-1656.1669627757
    Image ID:      docker-pullable://registry.access.redhat.com/ubi9/ubi-minimal@sha256:3685c58885771d2ea14608caeab6a4c3949b973588c29ce91f462b486ee1be25
    Port:          <none>
    Host Port:     <none>
    Command:
      chown
      -R
      472:472
      /var/lib/grafana
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Mon, 27 Feb 2023 16:54:10 +0000
      Finished:     Mon, 27 Feb 2023 16:54:10 +0000
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /var/lib/grafana from storage (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from k10-grafana-token-n8b5h (ro)
  download-dashboards:
    Container ID:  docker://bcf05939a66ebf00a99d6751c20424dd28ed4d414582dc7935e5749b9501574f
    Image:         registry.access.redhat.com/ubi9/ubi-minimal:9.1.0-1656.1669627757
    Image ID:      docker-pullable://registry.access.redhat.com/ubi9/ubi-minimal@sha256:3685c58885771d2ea14608caeab6a4c3949b973588c29ce91f462b486ee1be25
    Port:          <none>
    Host Port:     <none>
    Command:
      /bin/sh
    Args:
      -c
      mkdir -p /var/lib/grafana/dashboards/default && /bin/sh -x /etc/grafana/download_dashboards.sh
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Mon, 27 Feb 2023 16:54:12 +0000
      Finished:     Mon, 27 Feb 2023 16:54:12 +0000
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /etc/grafana/download_dashboards.sh from config (rw,path="download_dashboards.sh")
      /var/lib/grafana from storage (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from k10-grafana-token-n8b5h (ro)
Containers:
  grafana:
    Container ID:   docker://f2fedd588d7a1deb6d0ae430183365e34d82bcbd8177c1f957a86339f212bc1b
    Image:          grafana/grafana:9.1.5
    Image ID:       docker-pullable://grafana/grafana@sha256:05f1ea7c4b6aef700e007e42f86380d28263cde027f4e950220aa1ba661fb01b
    Ports:          80/TCP, 3000/TCP
    Host Ports:     0/TCP, 0/TCP
    State:          Running
      Started:      Mon, 27 Feb 2023 16:54:14 +0000
    Ready:          True
    Restart Count:  0
    Liveness:       http-get http://:3000/api/health delay=60s timeout=30s period=10s #success=1 #failure=10
    Readiness:      http-get http://:3000/api/health delay=0s timeout=1s period=10s #success=1 #failure=3
    Environment:
      GF_SECURITY_ADMIN_USER:      <set to the key 'admin-user' in secret 'k10-grafana'>      Optional: false
      GF_SECURITY_ADMIN_PASSWORD:  <set to the key 'admin-password' in secret 'k10-grafana'>  Optional: false
      GF_PATHS_DATA:               /var/lib/grafana/
      GF_PATHS_LOGS:               /var/log/grafana
      GF_PATHS_PLUGINS:            /var/lib/grafana/plugins
      GF_PATHS_PROVISIONING:       /etc/grafana/provisioning
    Mounts:
      /etc/grafana/grafana.ini from config (rw,path="grafana.ini")
      /etc/grafana/provisioning/dashboards/dashboardproviders.yaml from config (rw,path="dashboardproviders.yaml")
      /etc/grafana/provisioning/datasources/datasources.yaml from config (rw,path="datasources.yaml")
      /var/lib/grafana from storage (rw)
      /var/lib/grafana/dashboards/default/default.json from dashboards-default (rw,path="default.json")
      /var/run/secrets/kubernetes.io/serviceaccount from k10-grafana-token-n8b5h (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      k10-grafana
    Optional:  false
  dashboards-default:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      k10-grafana-dashboards-default
    Optional:  false
  storage:
    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
    ClaimName:  k10-grafana
    ReadOnly:   false
  k10-grafana-token-n8b5h:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  k10-grafana-token-n8b5h
    Optional:    false
QoS Class:       BestEffort
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age                  From     Message
  ----     ------            ----                 ----     -------
  Warning  DNSConfigForming  92s (x684 over 14h)  kubelet  Search Line limits were exceeded, some search paths have been omitted, the applied search line is: kasten-io.svc.cluster.local svc.cluster.local cluster.local zurich.com zurich.net mega.us.zurich.com
 

Userlevel 3

@Satish is there any way i can attach complete debug log file.

Userlevel 3

@Satish @jaiganeshjk  can i get any help still i am getting same error.

 

Thanks,

Neha

Userlevel 6
Badge +2

Hi Neha,

For immediate assistance, I would suggest you to open a case with us by logging into my.veeam.com and selecting the product Veeam Kasten by K10 Trial.

You can upload the entire log bundle to the case.

 

 

Comment