Skip to main content

HI I have installed K10 version 6.0.5 with helm on my k3s v1.25.7+k3s1. All the pods are running

 

but I cant access the website and if I look on the logs of the pod gateway I See that it cant find severales kind resource:

time="2023-08-21 10:39:31.9231" level=info msg="Started Ambassador (Version 3.5.0-dev.0.20230802031949-5128521c13df-dirty.1690961272)" func=github.com/emissary-ingress/emissary/v3/cmd/entrypoint.Main file="/go/cmd/entrypoint/entrypoint.go:96" CMD=entrypoint PID=1
time="2023-08-21 10:39:31.9689" level=info msg="AMBASSADOR_CLUSTER_ID=b708b74a-8699-5c3e-abb6-58d61c57d229" func=github.com/emissary-ingress/emissary/v3/cmd/entrypoint.Main file="/go/cmd/entrypoint/entrypoint.go:110" CMD=entrypoint PID=1
time="2023-08-21 10:39:31.9727" level=info msg="started command d\"diagd\" \"/ambassador/snapshots\" \"/ambassador/bootstrap-ads.json\" \"/ambassador/envoy/envoy.json\" \"--notices\" \"/ambassador/notices.json\" \"--port\" \"8004\" \"--kick\" \"kill -HUP 1\"]" func="github.com/datawire/dlib/dexec.(*Cmd).Start" file="/go/vendor/github.com/datawire/dlib/dexec/cmd.go:183" CMD=entrypoint PID=1 THREAD=/diagd dexec.pid=15
time="2023-08-21 10:39:31.9728" level=info msg="not logging input read from file \"/dev/stdin\"" func="github.com/datawire/dlib/dexec.(*Cmd).Start" file="/go/vendor/github.com/datawire/dlib/dexec/cmd.go:185" CMD=entrypoint PID=1 THREAD=/diagd dexec.pid=15 dexec.stream=stdin
time="2023-08-21 10:39:31.9728" level=info msg="not logging output written to file \"/dev/stdout\"" func="github.com/datawire/dlib/dexec.(*Cmd).Start" file="/go/vendor/github.com/datawire/dlib/dexec/cmd.go:188" CMD=entrypoint PID=1 THREAD=/diagd dexec.pid=15 dexec.stream=stdout
time="2023-08-21 10:39:31.9728" level=info msg="not logging output written to file \"/dev/stderr\"" func="github.com/datawire/dlib/dexec.(*Cmd).Start" file="/go/vendor/github.com/datawire/dlib/dexec/cmd.go:191" CMD=entrypoint PID=1 THREAD=/diagd dexec.pid=15 dexec.stream=stderr
time="2023-08-21 10:39:31.9728" level=info msg="Ambex 3.5.0-dev.0.20230802031949-5128521c13df-dirty.1690961272 starting, snapdirPath /ambassador/snapshots" func=github.com/emissary-ingress/emissary/v3/pkg/ambex.Main file="/go/pkg/ambex/main.go:646" CMD=entrypoint PID=1 THREAD=/ambex
time="2023-08-21 10:39:31.9808" level=info msg="Wrote PID" func=github.com/emissary-ingress/emissary/v3/pkg/ambex.Main file="/go/pkg/ambex/main.go:690" CMD=entrypoint PID=1 THREAD=/ambex fields.file=ambex.pid file="/go/pkg/ambex/main.go:690" pid=1
time="2023-08-21 10:39:31.9816" level=info msg="AMBASSADOR_RECONFIG_MAX_DELAY set to 1" func=github.com/emissary-ingress/emissary/v3/cmd/entrypoint.WatchAllTheThings file="/go/cmd/entrypoint/watcher.go:47" CMD=entrypoint PID=1 THREAD=/watcher
time="2023-08-21 10:39:31.9856" level=info msg="Saved snapshot v0" func=github.com/emissary-ingress/emissary/v3/pkg/ambex.csDump file="/go/pkg/ambex/main.go:349" CMD=entrypoint PID=1 THREAD=/ambex/main-loop
time="2023-08-21 10:39:31.9857" level=warning msg="Warning, unable to watch tlscontexts.v3alpha1.getambassador.io, unknown kind." func=github.com/emissary-ingress/emissary/v3/cmd/entrypoint.GetInterestingTypes file="/go/cmd/entrypoint/interesting_types.go:160" CMD=entrypoint PID=1 THREAD=/watcher
time="2023-08-21 10:39:31.9860" level=warning msg="Warning, unable to watch authservices.v3alpha1.getambassador.io, unknown kind." func=github.com/emissary-ingress/emissary/v3/cmd/entrypoint.GetInterestingTypes file="/go/cmd/entrypoint/interesting_types.go:160" CMD=entrypoint PID=1 THREAD=/watcher
time="2023-08-21 10:39:31.9862" level=warning msg="Warning, unable to watch kubernetesendpointresolvers.v3alpha1.getambassador.io, unknown kind." func=github.com/emissary-ingress/emissary/v3/cmd/entrypoint.GetInterestingTypes file="/go/cmd/entrypoint/interesting_types.go:160" CMD=entrypoint PID=1 THREAD=/watcher
time="2023-08-21 10:39:31.9863" level=warning msg="Warning, unable to watch ratelimitservices.v3alpha1.getambassador.io, unknown kind." func=github.com/emissary-ingress/emissary/v3/cmd/entrypoint.GetInterestingTypes file="/go/cmd/entrypoint/interesting_types.go:160" CMD=entrypoint PID=1 THREAD=/watcher
time="2023-08-21 10:39:31.9862" level=info msg="Pushing snapshot v0" func=github.com/emissary-ingress/emissary/v3/pkg/ambex.updaterWithTicker file="/go/pkg/ambex/ratelimit.go:159" CMD=entrypoint PID=1 THREAD=/ambex/updater
time="2023-08-21 10:39:31.9863" level=warning msg="Warning, unable to watch gatewayclasses.v1alpha1.networking.x-k8s.io, unknown kind." func=github.com/emissary-ingress/emissary/v3/cmd/entrypoint.GetInterestingTypes  …….

Can you help me please ?

 

Best regards.

HI, I have tried with version 6.0.4 and same errors :(


Best regards.


How are you trying to access the console? Ingress, port-forward or Lb?


HI Geoff,

I am trying with nginx ingress.

 

Best regards.


ok, so just to follow all the check marks, if you are using nginx ingress then you created your k3s cluster disabling the default traefik ingress controller that came with it? also did you leave the default load balancer turned on (klipper, although I think they have changed the name now). Then you installed nginx ingress controller. So you would need to install a load balancer as well if you disabled klipper. This might be obvious but I myself have sometimes missed a step so I always go over the simple stuff first just in case.

 

 


HI Geoff,

 

Yes I have disable traefik and installed nginx ingress. I dont know if I have a load balancer how I can check it ? My K3s is standalone and I have others applications depolyed on it that works correctly.

 

Best regards.

 


I was right they have a new name for it Service Load Balancer. If you did not disable it then it is probably running https://docs.k3s.io/networking

 

You said you have other applications running correctly through ingress? Then yes it could very well be the Kasten application. 

One thing to keep in mind is Service Load Balancer is  pretty limited and if one application takes the port then another can’t use it. At least I ran into that. If this is a test environment you might want to create a k3s cluster disabling Service Load Balancer as well and try MetalLB which is better for multi-node clusters and situations where you have a lot of apps on same ports: https://metallb.universe.tf/

 

Lets see what the Kasten folks say about those errors. I might be going down the wrong path.

cheers

 


HI Geoff,

I have disable the servicelb and try to install kasten but same issue. Investigating I can connect to the dashboard with port-forward but not from the nginx ingress. When I look it it appear without class:

kubectl -n kasten-io get ingress
NAME          CLASS    HOSTS                      ADDRESS           PORTS     AGE
k10-ingress   <none>   kasten.xxx.xx   139.162.122.80  80, 443   4m45s

on the values.yml file I have the ingress with class nginx but it seems to not handle the parameter:

ingress:
  create: true
  class: "nginx" #Ingress controller type
  tls:
    enabled: true
    secretName: kasten-tls
  host: "kasten.xxx.xx" #ingress object host name
  urlPath: "" #url path for k10 gateway
  pathType: "ImplementationSpecific"
  annotations:
    nginx.ingress.kubernetes.io/force-ssl-redirect: "true"
    nginx.ingress.kubernetes.io/backend-protocol: "HTTPS"
    cert-manager.io/cluster-issuer: "letsencrypt-prod-v1"
    nginx.ingress.kubernetes.io/proxy-body-size: "0"

 

Do I miss something on the values.yml ?

Best regards.


HI Geoff,

I have found a bypass. The problem is due to the creation of the ingress with helm when it set to create and class nginx it create an ingress with the annotation “kubernetes.io/ingress.class: nginx” and the ingress appear with class none. If I disable the creation of the ingress on the values.yml and create the ingress by myself without the annotation and with the spec “ingressClassName: nginx” I can access the dashboard.

 

Best regards.


Hello @reynald14 !

Thank you for sharing the solution with us, it help other users facing the same problem.

Recreating the ingress service manually is really helpful in these cases, since you can make sure you do not have any missing/wrong parameters.

 

Rubens


Glad to hear it and good to note that. 

 

cheers


Comment