Skip to main content

I have enabled Kasten DR to AWS but the hourly job fails with:

 

- cause:
    cause:
      cause:
        message: '{"message":"Failed to stream backup to remote kopia repository on
          Kopia API
          server","function":"kasten.io/k10/kio/kanister/function.moverBackupToServer","linenumber":252,"file":"kasten.io/k10/kio/kanister/function/mover_backup_to_server.go:252","cause":{"message":"Failed
          to exec command in
          pod","function":"github.com/kanisterio/kanister/pkg/kube.ExecWithOptions","linenumber":156,"file":"github.com/kanisterio/kanister@v0.0.0-20240812194716-8812756d1751/pkg/kube/exec.go","cause":{"message":"command
          terminated with exit code 1.\nstdout: Snapshotting
          k10-admin@ef31068b-5d9a-4942-8c88-803b69c098d2.catalog-svc.catalog-pv-claim:/mnt/k10state
          ...\r\nCreated snapshot with root ke298f0f55162d5d594839e9f8a2756c3
          and ID 011e05e2353da2dd07a8ef0e2d38e7b4 in 30s\nstderr: kando stream
          push \u003csource\u003e 2flags]\r\nFlags:\r\n-d, --dirPath
          string    Specify a root directory path for the data stream
          (required)\r\n-f, --filePath string   Specify a file name or path for
          the data stream (required)\r\n-h, --help              help for
          push\r\nGlobal Flags:\r\n-c, --config-file string   Custom config file
          for object storage repository configuration\r\n-p, --password
          string      Specify the password for object storage repository
          (required)\r\n-v, --verbosity string     Log level (debug, info, warn,
          error, fatal, panic) (default
          \"warning\")\r\n{\"File\":\"kando/main.go\",\"Function\":\"main.main\",\"Line\":22,\"error\":\"Failed
          to create kopia snapshot: Get
          \\\"http://10.101.245.220:8000/v0/backup\\\": dial tcp
          10.101.245.220:8000: i/o
          timeout\",\"hostname\":\"catalog-svc-66d66988bd-rghfm\",\"level\":\"info\",\"msg\":\"Kando
          failed to execute\",\"time\":\"2024-09-03T16:01:22.665990931Z\"}"}}}'
 

Is this an issue caused by something external to us?

Many thanks,

 

 

-Mark

 

Hello @virtualhobbit, Mark

 

So, after reviewing the error, you have above. Could you please provide what is the IP 10.101.245.220. 

 

I think you should be able to find this via looking through services.

 

kubectl get svc -n kasten-io

 

Thanks

Emmanuel


Hi Emmanuel,

That belongs to the catalog service.

 

-Mark


Hi @virtualhobbit ,
 Seems like there is connectivity issues to catalog-svc, Could you please confirm if catalog pods are up and running.
       kubectl get pods -n kasten-io

Also, Reviewing the debug logs would be helpful. Could you please gather the debug logs and share them with us over here or by raising a trail case.

Here are the instructions to gather the debug logs https://docs.kasten.io/latest/operating/support.html#gathering-debugging-information

 
Thanks,
Pavithra


Thanks. Case #07408527 created.


Comment