Question

Unable to restore (migrate) app into vSphere with Tanzu 8.0U2 TKG cluster


Badge

I’m unable to restore an application from an AWS snapshot & export to a vSphere with Tanzu 8.0U2 cluster. The error is:

                      String: >-
                        Unable to resolve WSDL method name CnsQueryVolume in
                        vim.version.v8_0_2_0 (vim25/8.0.2.0)


                        while parsing SOAP body

                        at line 2, column 202


                        while parsing SOAP envelope

                        at line 2, column 0


                        while parsing HTTP request before method was determined

                        at line 1, column 0

Anyone seen this error before?

Using Kasten K10 6.0.11.

Many thanks,

 

-Mark


12 comments

Userlevel 3
Badge +1

@virtualhobbit  - Thanks for reaching out to us. 

Can you help us in detail where are you seeing this error ? 

Is it at the import job or restore job  ? Can you paste the detailed error yaml of the Job which is failing?

 

Regards
Satish

Badge

Hi @Satish. It is the restore job. The Error is:

cause:
    cause:
      cause:
        cause:
          cause:
            errors:
              - cause:
                  cause:
                    Fault:
                      Code: ServerFaultCode
                      Detail:
                        Fault: {}
                      String: >-
                        Unable to resolve WSDL method name CnsQueryVolume in
                        vim.version.v8_0_2_0 (vim25/8.0.2.0)


                        while parsing SOAP body

                        at line 2, column 202


                        while parsing SOAP envelope

                        at line 2, column 0


                        while parsing HTTP request before method was determined

                        at line 1, column 0
                      XMLName:
                        Local: Fault
                        Space: http://schemas.xmlsoap.org/soap/envelope/
                  fields:
                    - name: id
                      value: 09ad54c0-5cb7-4f51-be27-eee0c109ddee-3963e3db-3c40-4223-b20b-b3bd7bb2d0a8
                  file: kasten.io/k10/kio/storage/vsphere.go:96
                  function: kasten.io/k10/kio/storage.(*fcdProvider).GetFCDIDForGuestClusterVolumeHandle
                  linenumber: 96
                  message: Cns.QueryVolume failed when searching for guest cluster volume
                file: kasten.io/k10/kio/exec/phases/phase/datamover_export.go:219
                function: kasten.io/k10/kio/exec/phases/phase.dmDownloadSnapshot
                linenumber: 219
                message: Custom download failure
              - cause:
                  cause:
                    Fault:
                      Code: ServerFaultCode
                      Detail:
                        Fault: {}
                      String: >-
                        Unable to resolve WSDL method name CnsQueryVolume in
                        vim.version.v8_0_2_0 (vim25/8.0.2.0)


                        while parsing SOAP body

                        at line 2, column 202


                        while parsing SOAP envelope

                        at line 2, column 0


                        while parsing HTTP request before method was determined

                        at line 1, column 0
                      XMLName:
                        Local: Fault
                        Space: http://schemas.xmlsoap.org/soap/envelope/
                  fields:
                    - name: id
                      value: 09ad54c0-5cb7-4f51-be27-eee0c109ddee-a7b492ed-5fcd-4e25-b031-cc029fd3a83d
                  file: kasten.io/k10/kio/storage/vsphere.go:96
                  function: kasten.io/k10/kio/storage.(*fcdProvider).GetFCDIDForGuestClusterVolumeHandle
                  linenumber: 96
                  message: Cns.QueryVolume failed when searching for guest cluster volume
                file: kasten.io/k10/kio/exec/phases/phase/datamover_export.go:219
                function: kasten.io/k10/kio/exec/phases/phase.dmDownloadSnapshot
                linenumber: 219
                message: Custom download failure

 

Userlevel 3
Badge +1

@virtualhobbit 

It seems unable to query the cns.volumes . 

Wondering if you are able to perform the regular backup/export activities on this Tanzu Cluster 8.0U2 . 

Can you run the primer to check it's able to backup/export/restore a sample app . 

https://docs.kasten.io/latest/operating/k10tools.html#vsphere-first-class-disk-integration-check

 

K10tools can be downloaded from here .

https://github.com/kastenhq/external-tools/releases

if this procedure works we can look deep on what could be causing the issue. 

Regards
Satish

Badge

Hi @Satish . It’s being backed up on another cluster, this is the restore.

Userlevel 3
Badge +1

@virtualhobbit - Agree . You have a source cluster with exports to AWS.

Wanted to run the primer on your Destination cluster (Tanzu 8.0.U2) because it does end to end functionality check . 

In your case when the restore is initiated, it's failing at cnsvolume query/creation . 

Addition to it am assuming the service account used to create Infrastructure profile in your destination cluster has enough privileges to create/query cnsvolumes. 

If you can open a free support case with us adding the logs to it can help in deep diving into this issue. 

 

Let me know if you have any questions. 

Regards
Satish

 

 

Badge

Hi @Satish . So it turns out K10 doesn’t support vSphere, at least not vSAN :-(

Using "./vsphere_check.yaml" file content as config source
-> Setup Provider
VSphere backup/restore checker:
  Failed to create FCD provider: The test cluster, TKGS cluster with paravirtualized volumes, is not supported by K10 for restoring FCD snapshots.  -  Error

Userlevel 3
Badge +1

Hi @virtualhobbit 

K10 Support vSphere but looks like paravirtualized volumes which is blocking the ability of FCD restore. 

https://www.kasten.io/kubernetes/resources/blog/tanzu-kasten-k10-exploring-whats-new

  • The guest clusters in vSphere with Tanzu use paravirtualized Persistent Volumes and these clusters do not support the static provisioning of a specific First-Class Disks (FCD) from within the guest cluster itself. This notably disables K10’s ability to restore applications from the local snapshots and the ability to export snapshot data in filesystem mode. 

 

I will try to get more details on this after speaking internally . 

Userlevel 3
Badge +1

@virtualhobbit 

May I know if the service account used has the following privilege ? 

“Searchable” CNS Privilege ?

Additionally, have you used the same service account to Run the Primer ?

Badge

Hi @Satish.

The service account has Administrator rights, which includes the “Cns, Searchable” privilege.

And yes, I used the same account :-)

Userlevel 3
Badge +1

@virtualhobbit 

In that case , can you open a free tier ticket with us with the debug logs . We can look into the logs and find out what can be the cause .

Badge

Hi @Satish. All done.

The case number is # 07013654.

Userlevel 5
Badge +2

@virtualhobbit w fixed an issue where applications restore was failing on vSphere Tanzu 8.0U2.

please try to upgrade to k10 v 6.5.0 and try again.

 

Thanks
Ahmed Hagag

Comment