Install kasten v7 and when i try to reliced to a backup failed the process with: username must be specified as lowercase 'user@hostname'"

Question

Intall kasten in openshift 4.14 (vsphere), intall version 7 kasten with helm

this is details for the error:

- cause:
cause:
cause:
cause:
cause:
message: "Failed to exec command in pod: command terminated with exit code 1.

stdout:\

stderr: \e>31mERROR\e�0m error setting user profile: username must
be specified as lowercase 'user@hostname'"
file: kasten.io/k10/kio/kopiaapiserver/utils.go:634
function: kasten.io/k10/kio/kopiaapiserver.setupServerUsers
linenumber: 634
message: Failed to add new user to the Kopia API server
file: kasten.io/k10/kio/kopiaapiserver/utils.go:453
function: kasten.io/k10/kio/kopiaapiserver.initializeAPIServerWithUserModification
linenumber: 453
message: Failed to setup Kopia API server users
file: kasten.io/k10/kio/kopiaapiserver/api_server.go:138
function: kasten.io/k10/kio/kopiaapiserver.SetupAPIServer
linenumber: 138
message: Failed to initialize Kopia API server
file: kasten.io/k10/kio/exec/phases/backup/snapshot_images_phase.go:166
function: kasten.io/k10/kio/exec/phases/backup.(*SnapshotImagesPhase).Run
linenumber: 166
message: Failed prepare a kopia api server
message: Job failed to be executed
- cause:
cause:
cause:
cause:
cause:
message: "Failed to exec command in pod: command terminated with exit code 1.

stdout:\

stderr: \e 31mERROR\en0m error setting user profile: username must
be specified as lowercase 'user@hostname'"
file: kasten.io/k10/kio/kopiaapiserver/utils.go:634
function: kasten.io/k10/kio/kopiaapiserver.setupServerUsers
linenumber: 634
message: Failed to add new user to the Kopia API server
file: kasten.io/k10/kio/kopiaapiserver/utils.go:453
function: kasten.io/k10/kio/kopiaapiserver.initializeAPIServerWithUserModification
linenumber: 453
message: Failed to setup Kopia API server users
file: kasten.io/k10/kio/kopiaapiserver/api_server.go:138
function: kasten.io/k10/kio/kopiaapiserver.SetupAPIServer
linenumber: 138
message: Failed to initialize Kopia API server
file: kasten.io/k10/kio/exec/phases/backup/snapshot_images_phase.go:166
function: kasten.io/k10/kio/exec/phases/backup.(*SnapshotImagesPhase).Run
linenumber: 166
message: Failed prepare a kopia api server
message: Job failed to be executed

I find this error en the logs od the pods:
Log message dropped (buffer): {"File":"kasten.io/k10/kio/tracing/tracing.go","Function":"kasten.io/k10/kio/tracing.StartProfileBuffers","Level":"info","Line":109,"Message":"no profile buffers configured","Time":"2024-06-09T19:17:29.703644066Z","cluster_name":"91f004f7-0306-4776-b81b-d7b9bb0338fe","hostname":"aggregatedapis-svc-69f7779b79-xv69g","version":"7.0.0"}
Error: {"message":"Fluentbit connection error","function":"kasten.io/k10/kio/log/hooks/fluentbit.(*Hook).handle","linenumber":97,"file":"kasten.io/k10/kio/log/hooks/fluentbit/fluentbit.go:97","cause":{"message":"Fluentbit connection problem","function":"kasten.io/k10/kio/log/hooks/fluentbit.(*Hook).dial","linenumber":88,"file":"kasten.io/k10/kio/log/hooks/fluentbit/fluentbit.go:88","cause":{"message":"dial tcp 172.30.24.71:24224: i/o timeout"}}}
{"File":"kasten.io/k10/kio/aggapi/util/errors.go","Function":"kasten.io/k10/kio/aggapi/util.WrapError","Line":25,"cluster_name":"91f004f7-0306-4776-b81b-d7b9bb0338fe","error":{"message":"Could not retrieve artifacts for prefix search","function":"kasten.io/k10/kio/rest/clients.FetchArtifactsForSearchPrefix","linenumber":65,"file":"kasten.io/k10/kio/rest/clients/catalogclient.go:65","fields":n{"name":"config","value":{}},{"name":"retries","value":1}],"cause":{"message":"Get \"http://172.30.91.171:8000/v0/artifacts/prefixSearch?key=api-list-prefix-key-restorepointcontents.apps.kio.kasten.io\u0026limit=500\u0026reverseOrder=true\u0026value=%40\": dial tcp 172.30.91.171:8000: connect: connection refused"}},"hostname":"aggregatedapis-svc-69f7779b79-xv69g","level":"error","msg":"Internal Error","time":"2024-06-09T19:17:45.177Z","version":"7.0.0"}
I0609 19:17:45.177784 1 trace.go:236] Trace 253428257]: "List" accept:application/json, */*,audit-id:d84d56a4-fa47-4d8b-8b68-11ef57a67d0c,client:10.9.32.33,api-group:apps.kio.kasten.io,api-version:v1alpha1,name:,subresource:,namespace:,protocol:HTTP/2.0,resource:restorepointcontents,scope:cluster,url:/apis/apps.kio.kasten.io/v1alpha1/restorepointcontents,user-agent:garbagecollector-server/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (09-Jun-2024 19:17:44.129) (total time: 1048ms):
Tracel253428257]: k1.048218323s] 11.048218323s] END
{"File":"kasten.io/k10/kio/aggapi/util/errors.go","Function":"kasten.io/k10/kio/aggapi/util.WrapError","Line":25,"cluster_name":"91f004f7-0306-4776-b81b-d7b9bb0338fe","error":{"message":"Could not retrieve artifacts for prefix search","function":"kasten.io/k10/kio/rest/clients.FetchArtifactsForSearchPrefix","linenumber":65,"file":"kasten.io/k10/kio/rest/clients/catalogclient.go:65","fields":n{"name":"config","value":{}},{"name":"retries","value":1}],"cause":{"message":"Get \"http://172.30.91.171:8000/v0/artifacts/prefixSearch?key=api-list-prefix-key-clusterrestorepoints.apps.kio.kasten.io\u0026limit=500\u0026reverseOrder=true\u0026value=%40\": dial tcp 172.30.91.171:8000: connect: connection refused"}},"hostname":"aggregatedapis-svc-69f7779b79-xv69g","level":"error","msg":"Internal Error","time":"2024-06-09T19:17:45.177Z","version":"7.0.0"}
I0609 19:17:45.177932 1 trace.go:236] Trace 290465561]: "List" accept:application/json, */*,audit-id:20300309-b7ab-400f-97bf-5eb69cafea40,client:10.9.32.33,api-group:apps.kio.kasten.io,api-version:v1alpha1,name:,subresource:,namespace:,protocol:HTTP/2.0,resource:clusterrestorepoints,scope:cluster,url:/apis/apps.kio.kasten.io/v1alpha1/clusterrestorepoints,user-agent:garbagecollector-server/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (09-Jun-2024 19:17:44.130) (total time: 1047ms):
Tracel290465561]: k1.047692214s] 11.047692214s] END
Log message dropped (buffer): {"File":"kasten.io/k10/kio/aggapi/util/errors.go","Function":"kasten.io/k10/kio/aggapi/util.WrapError","Level":"error","Line":25,"Message":"Internal Error","Time":"2024-06-09T19:17:45.177460574Z","cluster_name":"91f004f7-0306-4776-b81b-d7b9bb0338fe","error":{"message":"Could not retrieve artifacts for prefix search","function":"kasten.io/k10/kio/rest/clients.FetchArtifactsForSearchPrefix","linenumber":65,"file":"kasten.io/k10/kio/rest/clients/catalogclient.go:65","fields":n{"name":"config","value":{}},{"name":"retries","value":1}],"cause":{"message":"Get \"http://172.30.91.171:8000/v0/artifacts/prefixSearch?key=api-list-prefix-key-clusterrestorepoints.apps.kio.kasten.io\u0026limit=500\u0026reverseOrder=true\u0026value=%40\": dial tcp 172.30.91.171:8000: connect: connection refused"}},"hostname":"aggregatedapis-svc-69f7779b79-xv69g","version":"7.0.0"}
{"File":"kasten.io/k10/kio/aggapi/util/errors.go","Function":"kasten.io/k10/kio/aggapi/util.WrapError","Level":"error","Line":25,"Message":"Internal Error","Time":"2024-06-09T19:17:45.177462485Z","cluster_name":"91f004f7-0306-4776-b81b-d7b9bb0338fe","error":{"message":"Could not retrieve artifacts for prefix search","function":"kasten.io/k10/kio/rest/clients.FetchArtifactsForSearchPrefix","linenumber":65,"file":"kasten.io/k10/kio/rest/clients/catalogclient.go:65","fields":n{"name":"config","value":{}},{"name":"retries","value":1}],"cause":{"message":"Get \"http://172.30.91.171:8000/v0/artifacts/prefixSearch?key=api-list-prefix-key-restorepointcontents.apps.kio.kasten.io\u0026limit=500\u0026reverseOrder=true\u0026value=%40\": dial tcp 172.30.91.171:8000: connect: connection refused"}},"hostname":"aggregatedapis-svc-69f7779b79-xv69g","version":"7.0.0"}
Error: {"message":"Fluentbit connection error","function":"kasten.io/k10/kio/log/hooks/fluentbit.(*Hook).handle","linenumber":97,"file":"kasten.io/k10/kio/log/hooks/fluentbit/fluentbit.go:97","cause":{"message":"Fluentbit connection problem","function":"kasten.io/k10/kio/log/hooks/fluentbit.(*Hook).dial","linenumber":88,"file":"kasten.io/k10/kio/log/hooks/fluentbit/fluentbit.go:88","cause":{"message":"dial tcp 172.30.24.71:24224: i/o timeout"}}}
{"File":"kasten.io/k10/kio/aggapi/util/errors.go","Function":"kasten.io/k10/kio/aggapi/util.WrapError","Line":25,"cluster_name":"91f004f7-0306-4776-b81b-d7b9bb0338fe","error":{"message":"Could not retrieve artifacts for prefix search","function":"kasten.io/k10/kio/rest/clients.FetchArtifactsForSearchPrefix","linenumber":65,"file":"kasten.io/k10/kio/rest/clients/catalogclient.go:65","fields":n{"name":"config","value":{}},{"name":"retries","value":2}],"cause":{"message":"Get \"http://172.30.91.171:8000/v0/artifacts/prefixSearch?key=api-list-prefix-key-backupactions.actions.kio.kasten.io\u0026limit=300\u0026reverseOrder=true\u0026value=%40\": dial tcp 172.30.91.171:8000: connect: connection refused"}},"hostname":"aggregatedapis-svc-69f7779b79-xv69g","level":"error","msg":"Internal Error","time":"2024-06-09T19:18:14.590Z","version":"7.0.0"}
I0609 19:18:14.590467 1 trace.go:236] Trace 2079571833]: "List" accept:application/json, */*,audit-id:36cfc6e2-4ae1-4e99-9033-41c1fdb89ec1,client:10.9.32.64,api-group:actions.kio.kasten.io,api-version:v1alpha1,name:,subresource:,namespace:,protocol:HTTP/2.0,resource:backupactions,scope:cluster,url:/apis/actions.kio.kasten.io/v1alpha1/backupactions,user-agent:dashboardbff-server/v0.0.0 (linux/amd64) kubernetes/$Format,verb:LIST (09-Jun-2024 19:17:55.967) (total time: 18622ms):
Traces2079571833]: /18.622958962s] t18.622958962s] END
{"File":"kasten.io/k10/kio/aggapi/util/errors.go","Function":"kasten.io/k10/kio/aggapi/util.WrapError","Line":25,"cluster_name":"91f004f7-0306-4776-b81b-d7b9bb0338fe","error":{"message":"Could not retrieve artifacts for prefix search","function":"kasten.io/k10/kio/rest/clients.FetchArtifactsForSearchPrefix","linenumber":65,"file":"kasten.io/k10/kio/rest/clients/catalogclient.go:65","fields":n{"name":"config","value":{}},{"name":"retries","value":1}],"cause":{"message":"Get \"http://172.30.91.171:8000/v0/artifacts/prefixSearch?key=api-list-prefix-key-backupactions.actions.kio.kasten.io\u0026limit=300\u0026reverseOrder=true\u0026value=%40\": dial tcp 172.30.91.171:8000: connect: connection refused"}},"hostname":"aggregatedapis-svc-69f7779b79-xv69g","level":"error","msg":"Internal Error","time":"2024-06-09T19:18:25.972Z","version":"7.0.0"}
{"kind":"K10Event","apiVersion":"audit.k8s.io/v1","Level":"RequestResponse","AuditID":"477397e5-87e9-4584-b2ba-b3a0cb694da4","Stage":"ResponseComplete","RequestURI":"/apis/actions.kio.kasten.io/v1alpha1/namespaces/kasten-io/runactions","Verb":"create","User":{"username":"system:serviceaccount:kasten-io:k10-k10","groups":a"system:serviceaccounts","system:serviceaccounts:kasten-io","system:authenticated"],"extra":{"authentication.kubernetes.io/pod-name":e"dashboardbff-svc-d94c656f7-zc64v"],"authentication.kubernetes.io/pod-uid":s"2d1c7a2c-866d-4134-be5f-33169a7a89d6"]}},"ImpersonatedUser":null,"SourceIPs":t"10.9.32.64","10.129.0.1"],"UserAgent":"dashboardbff-server/v0.0.0 (linux/amd64) kubernetes/$Format","ObjectRef":{"Resource":"runactions","Namespace":"kasten-io","Name":"","UID":"","APIGroup":"actions.kio.kasten.io","APIVersion":"v1alpha1","ResourceVersion":"","Subresource":""},"ResponseStatus":{"metadata":{},"code":201},"RequestObject":{"kind":"RunAction","apiVersion":"actions.kio.kasten.io/v1alpha1","met…

Page 1 / 1

Hello @hybridcloud,

So my understanding is you tried to perform a backup with a export and recieved the error above. With the Location Profile could you verify that no uppercase characters are in the username/bucket name.

Thanks

Emmanuel

The issue you described has been identified as a bug and has been confirmed to be fixed starting from version 7.0.9. Please consider upgrading your K10 installation. Thank you.

Comment

EBrockman · Answer

Hello @hybridcloud,So my understanding is you tried to perform a backup with a export and recieved the error above. With the Location Profile could you verify that no uppercase characters are in the username/bucket name.ThanksEmmanuel

Comment

Sign up

Login to the community

Scanning file for viruses.

This file cannot be downloaded