Skip to main content
Question

k10 backup failed with error Failed to receive upload response

  • July 29, 2026
  • 3 comments
  • 39 views
A

Hi,

 

We are protecting a virtual machine in OCP, backup failed on export phase showing the below:
status:
  endTime: "2026-07-28T11:38:02Z"
  error:
    cause: '{"cause":{"cause":{"message":"Failure in exporting restorepoint"},"fields":[{"name":"FailedSubPhases","value":[{"Err":{"cause":{"cause":{"cause":{"cause":{"cause":{"cause":{"cause":{"cause":{"cause":{"cause":{"message":"rpc
      error: code = DeadlineExceeded desc = context deadline exceeded"},"fields":[{"name":"snapshotID","value":"k10-csi-snap-d9lxt6q44c8s2sqw"},{"name":"sourceDeviceFile","value":"/mnt/sourceDevice/kanister-pvc-pnwzb"},{"name":"volumeID","value":"test112-vm-186544-mm2tf"}],"file":"kasten.io/api/datamover/client/backup_service.go:71","function":"kasten.io/api/datamover/client.(*backupServiceImpl).Upload","linenumber":71,"message":"failed
      to receive upload response"},"fields":[{"name":"pod","value":"block-mode-upload-t8rqz"},{"name":"snapshotID","value":"k10-csi-snap-d9lxt6q44c8s2sqw"},{"name":"sourceDeviceFile","value":"/mnt/sourceDevice/kanister-pvc-pnwzb"},{"name":"volumeID","value":"test112-vm-186544-mm2tf"}],"file":"kasten.io/k10/kio/datamover/upload_pod.go:1020","function":"kasten.io/k10/kio/datamover.(*UploadPodImpl).runUploadSnapshotCmd","linenumber":1020,"message":"failed
      to upload exported volume snapshot"},"file":"kasten.io/k10/kio/exec/internal/backupobjects/utils.go:719","function":"kasten.io/k10/kio/exec/internal/backupobjects.DMUploadSnapshot","linenumber":719,"message":"Custom
      upload failure"},"file":"kasten.io/k10/kio/exec/internal/backupobjects/export_alg.go:505","function":"kasten.io/k10/kio/exec/internal/backupobjects.(*ExportAlg).exportBlockModeObjectSingleVolPod","linenumber":505,"message":"Error
      uploading snapshot"},"fields":[{"name":"type","value":"CSI"},{"name":"id","value":"k10-csi-snap-d9lxt6q44c8s2sqw"}],"file":"kasten.io/k10/kio/exec/internal/backupobjects/export_alg.go:266","function":"kasten.io/k10/kio/exec/internal/backupobjects.(*ExportAlg).Process.func3","linenumber":266,"message":"Failed
      to export snapshot data"},"file":"kasten.io/k10/kio/exec/phases/phase/artifactcopier.go:461","function":"kasten.io/k10/kio/exec/phases/phase.(*ArtifactCopier).convertSnapshots.func2","linenumber":461,"message":"algorithm
      failed"},"file":"kasten.io/k10/kio/exec/phases/phase/artifactcopier.go:244","function":"kasten.io/k10/kio/exec/phases/phase.(*ArtifactCopier).Copy","linenumber":244,"message":"Error
      converting snapshots"},"file":"kasten.io/k10/kio/exec/phases/phase/export.go:270","function":"kasten.io/k10/kio/exec/phases/phase.(*exportRestorePointPhase).performCopyToKopia","linenumber":270,"message":"failed
      to copy artifacts"},"file":"kasten.io/k10/kio/exec/phases/phase/export.go:169","function":"kasten.io/k10/kio/exec/phases/phase.(*exportRestorePointPhase).Run","linenumber":169,"message":"failed
      to copy to kopia"},"fields":[],"message":"Job failed to be executed"},"ID":"aec70853-8a65-11f1-9dd4-0a580ada064f","Phase":"Exporting
      RestorePoint"}]}],"file":"kasten.io/k10/kio/exec/phases/phase/queue_and_wait_children.go:200","function":"kasten.io/k10/kio/exec/phases/phase.(*queueAndWaitChildrenPhase).processGroup","linenumber":200,"message":"Failure
      in exporting restorepoint"},"fields":[{"name":"manifestID","value":"a30393b0-8a65-11f1-9dd4-0a580ada064f"},{"name":"jobID","value":"a305c5d8-8a65-11f1-b325-0a580ad90a41"},{"name":"groupIndex","value":0}],"file":"kasten.io/k10/kio/exec/phases/phase/queue_and_wait_children.go:101","function":"kasten.io/k10/kio/exec/phases/phase.(*queueAndWaitChildrenPhase).Run","linenumber":101,"message":"Failed
      checking jobs in group"}'
    message: Job failed to be executed
 

exporting pods in namespace is working fine, only virtual machine export is failing.

Any advise?

    3 comments

    S
    Forum|alt.badge.img+1
    • Satish
    • Experienced User
    • July 29, 2026

    hi ​@Ali Kanso 

    Thanks for reaching out to us. 

    Based on the error, this appears to be a context deadline exceeded issue, which means the operation is hitting some type of timeout.

    Could you please confirm how long the backup job ran before it failed? Also, what is the size of the VM? What is your CSI Driver ? 

    Regards
    Satish

      A
      • Ali Kanso
      • Author
      • Comes here often
      • July 29, 2026

      Hi Satish,

      Thanks for your immediate response.
      It took around 40 min and get failed.
      PVCs inside this namespace is 7 TB and CSI is csi.trident.netapp.io.
       

      S
      Forum|alt.badge.img+1
      • Satish
      • Experienced User
      • August 3, 2026

      Hi ​@Ali Kanso ,

      Apologies for the delayed response.

      As you mentioned, 40–45 minutes is quite long, so there is a high chance this is related to the pod readiness timeout. I’m wondering whether the export pods triggered during the export were becoming ready within 15 minutes, considering the 3 retry attempts. I would recommend checking the events along with the pods in the kasten-io namespace during the export run.

      You can tweak the following values according to your environment. If the pods are taking longer than 15 minutes to move into the Running state, I would also check the CSI driver to confirm whether it is provisioning the temporary volume within the expected timeframe.

      If you are still seeing the issue, I would encourage you to open a support case, even with the free tier, so we can take a deeper look into the problem.

      timeout.workerPodReady Specifies the timeout (in minutes) for all other temporary worker Pods used during Veeam Kasten operations 15

       

      timeout.blueprintBackup Specifies the timeout (in minutes) for Blueprint backup actions 45
      Terms & ConditionsAccessibility statement