Failed calling webhook v1.vseldondeployment.kb.io
Closed this issue ยท 22 comments
ucsky commented
Hello, can somebody help me with this?
Describe the bug
When I run
kind create cluster --name seldon
kubectl create namespace seldon-system
helm install seldon-core seldon-core-operator \
--repo https://storage.googleapis.com/seldon-charts \
--set usageMetrics.enabled=true \
--namespace seldon-system \
--set istio.enabled=true
kubectl create namespace seldon
kubectl apply -f - << END
apiVersion: machinelearning.seldon.io/v1
kind: SeldonDeployment
metadata:
name: iris-model
namespace: seldon
spec:
name: iris
predictors:
- graph:
implementation: SKLEARN_SERVER
modelUri: gs://seldon-models/v1.12.0-dev/sklearn/iris
name: classifier
name: default
replicas: 1
END
I got the following error:
Creating cluster "seldon" ...
โ Ensuring node image (kindest/node:v1.21.1) ๐ผ
โ Preparing nodes ๐ฆ
โ Writing configuration ๐
โ Starting control-plane ๐น๏ธ
โ Installing CNI ๐
โ Installing StorageClass ๐พ
Set kubectl context to "kind-seldon"
You can now use your cluster with:
kubectl cluster-info --context kind-seldon
Not sure what to do next? ๐
Check out https://kind.sigs.k8s.io/docs/user/quick-start/
namespace/seldon-system created
W1006 12:26:19.668867 81316 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1006 12:26:19.670959 81316 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1006 12:26:19.674920 81316 warnings.go:70] admissionregistration.k8s.io/v1beta1 ValidatingWebhookConfiguration is deprecated in v1.16+, unavailable in v1.22+; use admissionregistration.k8s.io/v1 ValidatingWebhookConfiguration
W1006 12:26:20.127845 81316 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1006 12:26:20.132767 81316 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1006 12:26:20.156562 81316 warnings.go:70] admissionregistration.k8s.io/v1beta1 ValidatingWebhookConfiguration is deprecated in v1.16+, unavailable in v1.22+; use admissionregistration.k8s.io/v1 ValidatingWebhookConfiguration
NAME: seldon-core
LAST DEPLOYED: Wed Oct 6 12:26:18 2021
NAMESPACE: seldon-system
STATUS: deployed
REVISION: 1
TEST SUITE: None
namespace/seldon created
Error from server (InternalError): error when creating "STDIN": Internal error occurred: failed calling webhook "v1.vseldondeployment.kb.io": Post "https://seldon-webhook-service.seldon-system.svc:443/validate-machinelearning-seldon-io-v1-seldondeployment?timeout=30s": dial tcp 10.96.242.204:443: connect: no route to host
Expected behaviour
A running example.
Env.
- Cloud Provider: Kind
- Kubernetes Cluster Version: Client Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.4", GitCommit:"3cce4a82b44f032d0cd1a1790e6d2f5a55d20aae", GitTreeState:"clean", BuildDate:"2021-08-11T18:16:05Z", GoVersion:"go1.16.7", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.1", GitCommit:"5e58841cce77d4bc13713ad2b91fa0d961e69192", GitTreeState:"clean", BuildDate:"2021-05-21T23:01:33Z", GoVersion:"go1.16.4", Compiler:"gc", Platform:"linux/amd64"}
ukclivecox commented
Did you install istio? As you are installing with helm with --set istio.enabled=true
ucsky commented
I just tried without --set istio.enabled=true and I get the same error:
And making sure that iostio is installed using
#!/bin/bash
kind create cluster --name seldon
kubectl create namespace seldon-system
istioctl install
helm install seldon-core seldon-core-operator \
--repo https://storage.googleapis.com/seldon-charts \
--set usageMetrics.enabled=true \
--namespace seldon-system \
--set istio.enabled=true
#
#--set ambassador.enabled=true
kubectl create namespace seldon
kubectl apply -f - << END
apiVersion: machinelearning.seldon.io/v1
kind: SeldonDeployment
metadata:
name: iris-model
namespace: seldon
spec:
name: iris
predictors:
- graph:
implementation: SKLEARN_SERVER
modelUri: gs://seldon-models/v1.12.0-dev/sklearn/iris
name: classifier
name: default
replicas: 1
END
I till get the same error:
Error from server (InternalError): error when creating "STDIN": Internal error occurred: failed calling webhook "v1.vseldondeployment.kb.io": Post "https://seldon-webhook-service.seldon-system.svc:443/validate-machinelearning-seldon-io-v1-seldondeployment?timeout=30s": dial tcp 10.96.53.200:443: connect: connection refused
And making sure that
ukclivecox commented
Can you check the installed operator is running without error?
ucsky commented
I just checked in Lens and all operator are running without error: screenshoot
axsaucedo commented
I have tried replicating but don't seem to be able to get this error:
~ ๎ฐ kind create cluster --name seldon
Creating cluster "seldon" ...
โ Ensuring node image (kindest/node:v1.21.1) ๐ผ
โ Preparing nodes ๐ฆ
โ Writing configuration ๐
โ Starting control-plane ๐น๏ธ
โ Installing CNI ๐
โ Installing StorageClass ๐พ
Set kubectl context to "kind-seldon"
You can now use your cluster with:
kubectl cluster-info --context kind-seldon
Have a nice day! ๐
~ ๎ฐ kgp
No resources found in default namespace.
~ ๎ฐ istioctl install -y
โ Istio core installed
โ Istiod installed
โ Ingress gateways installed
โ Installation complete Thank you for installing Istio 1.10. Please take a few minutes to tell us about your install/upgrade experience! https://forms.gle/KjkrDnMPByq7akrYA
~ ๎ฐ kgp -n seldon-system
No resources found in seldon-system namespace.
~ ๎ฐ kgp
No resources found in default namespace.
~ ๎ฐ kgp -A
NAMESPACE NAME READY STATUS RESTARTS AGE
istio-system istio-ingressgateway-67c99c69bd-xljkz 1/1 Running 0 27s
istio-system istiod-6bf8dd57f8-6j2b2 1/1 Running 0 53s
kube-system coredns-558bd4d5db-m25wn 1/1 Running 0 54s
kube-system coredns-558bd4d5db-rkpx6 1/1 Running 0 54s
kube-system etcd-seldon-control-plane 1/1 Running 0 64s
kube-system kindnet-6jpgx 1/1 Running 0 55s
kube-system kube-apiserver-seldon-control-plane 1/1 Running 0 64s
kube-system kube-controller-manager-seldon-control-plane 1/1 Running 0 64s
kube-system kube-proxy-l2m68 1/1 Running 0 55s
kube-system kube-scheduler-seldon-control-plane 1/1 Running 0 64s
local-path-storage local-path-provisioner-547f784dff-ltrrb 1/1 Running 0 54s
~ ๎ฐ kubectl delete sdep --all
~ ๎ฐ kubectl create namespace seldon
namespace/seldon created
The Namespace "seldon-system#" is invalid:
* metadata.name: Invalid value: "seldon-system#": a lowercase RFC 1123 label must consist of lower case alphanumeric characters or '-', and must start and end with an alphanumeric character (e.g. 'my-name', or '123-abc', regex used for validation is '[a-z0-9]([-a-z0-9]*[a-z0-9])?')
* metadata.labels: Invalid value: "seldon-system#": a valid label must be an empty string or consist of alphanumeric characters, '-', '_' or '.', and must start and end with an alphanumeric character (e.g. 'MyValue', or 'my_value', or '12345', regex used for validation is '(([A-Za-z0-9][-A-Za-z0-9_.]*)?[A-Za-z0-9])?')
~ ๎ฐ kubectl create namespace seldon-system
namespace/seldon-system created
Found existing alias for "kubectl". You should use: "k"
~ ๎ฐ kg validatingwebhookconfigurations
NAME WEBHOOKS AGE
istiod-istio-system 1 93s
~ ๎ฐ
NAMESPACE
~ ๎ฐ helm install seldon-core seldon-core-operator \ ๎ฒ 1 โต ๎ฒ miniconda3 โค kind-seldon ~ ns:default โฏ
--repo https://storage.googleapis.com/seldon-charts \
--set usageMetrics.enabled=true \
--namespace seldon-system \
--set istio.enabled=true
NAME: seldon-core
LAST DEPLOYED: Thu Oct 7 06:33:07 2021
NAMESPACE: seldon-system
STATUS: deployed
REVISION: 1
TEST SUITE: None
~ ๎ฐ kg validatingwebhookconfigurations
NAME WEBHOOKS AGE
istiod-istio-system 1 2m
seldon-validating-webhook-configuration-seldon-system 3 3s
~ ๎ฐ kubectl apply -f - << END
apiVersion: machinelearning.seldon.io/v1
kind: SeldonDeployment
metadata:
name: iris-model
namespace: seldon
spec:
name: iris
predictors:
- graph:
implementation: SKLEARN_SERVER
modelUri: gs://seldon-models/v1.12.0-dev/sklearn/iris
name: classifier
name: default
replicas: 1
END
seldondeployment.machinelearning.seldon.io/iris-model created
~ ๎ฐ kgp
No resources found in default namespace.
~ ๎ฐ kgp -n seldon
NAME READY STATUS RESTARTS AGE
iris-model-default-0-classifier-756cd65667-5b8vx 0/2 PodInitializing 0 15s
ucsky commented
Hello, thanks for the help, my kind is version 0.11.1
I try exactly the same command but still got the same error:
ucsky@machine:~/$ ./setup-2.bash
#!/bin/bash -ev
kind create cluster --name seldon
Creating cluster "seldon" ...
โข Ensuring node image (kindest/node:v1.21.1) ๐ผ ...
โ Ensuring node image (kindest/node:v1.21.1) ๐ผ
โข Preparing nodes ๐ฆ ...
โ Preparing nodes ๐ฆ
โข Writing configuration ๐ ...
โ Writing configuration ๐
โข Starting control-plane ๐น๏ธ ...
โ Starting control-plane ๐น๏ธ
โข Installing CNI ๐ ...
โ Installing CNI ๐
โข Installing StorageClass ๐พ ...
โ Installing StorageClass ๐พ
Set kubectl context to "kind-seldon"
You can now use your cluster with:
kubectl cluster-info --context kind-seldon
Thanks for using kind! ๐
kubectl get pods
No resources found in default namespace.
istioctl install -y
โ Istio core installed
โ Istiod installed
โ Ingress gateways installed
โ Installation complete
Thank you for installing Istio 1.11. Please take a few minutes to tell us about your install/upgrade experience! https://forms.gle/kWULBRjUv7hHci7T6
kubectl get pods
No resources found in default namespace.
kubectl get pods -A
NAMESPACE NAME READY STATUS RESTARTS AGE
istio-system istio-ingressgateway-7776dd578-t5z89 1/1 Running 0 7s
istio-system istiod-56c76db8bc-5xmh2 1/1 Running 0 28s
kube-system coredns-558bd4d5db-c7697 1/1 Running 0 28s
kube-system coredns-558bd4d5db-gvddd 1/1 Running 0 28s
kube-system etcd-seldon-control-plane 1/1 Running 0 31s
kube-system kindnet-jxsr4 1/1 Running 0 28s
kube-system kube-apiserver-seldon-control-plane 1/1 Running 0 45s
kube-system kube-controller-manager-seldon-control-plane 1/1 Running 0 44s
kube-system kube-proxy-mlrww 1/1 Running 0 28s
kube-system kube-scheduler-seldon-control-plane 1/1 Running 0 31s
local-path-storage local-path-provisioner-547f784dff-ptpw7 1/1 Running 0 28s
kubectl create namespace seldon
namespace/seldon created
kubectl create namespace seldon-system
namespace/seldon-system created
kubectl get validatingwebhookconfigurations
NAME WEBHOOKS AGE
istio-validator-istio-system 2 39s
kubectl apply -f - << END
apiVersion: machinelearning.seldon.io/v1
kind: SeldonDeployment
metadata:
name: iris-model
namespace: seldon
spec:
name: iris
predictors:
- graph:
implementation: SKLEARN_SERVER
modelUri: gs://seldon-models/v1.12.0-dev/sklearn/iris
name: classifier
name: default
replicas: 1
END
error: unable to recognize "STDIN": no matches for kind "SeldonDeployment" in version "machinelearning.seldon.io/v1"
ukclivecox commented
You didn't install Seldon Core helm chart in the above example.
ucsky commented
I fixed it and now I do exactly the same as you.
#!/bin/bash -ev
kind create cluster --name seldon
Creating cluster "seldon" ...
โ Ensuring node image (kindest/node:v1.21.1) ๐ผ
โ Preparing nodes ๐ฆ
โ Writing configuration ๐
โ Starting control-plane ๐น๏ธ
โ Installing CNI ๐
โ Installing StorageClass ๐พ
Set kubectl context to "kind-seldon"
You can now use your cluster with:
kubectl cluster-info --context kind-seldon
Have a question, bug, or feature request? Let us know! https://kind.sigs.k8s.io/#community ๐
kubectl get pods
No resources found in default namespace.
istioctl install -y
โ Istio core installed
โ Istiod installed
โ Ingress gateways installed
โ Installation complete
Thank you for installing Istio 1.11. Please take a few minutes to tell us about your install/upgrade experience! https://forms.gle/kWULBRjUv7hHci7T6
kubectl get pods
No resources found in default namespace.
kubectl get pods -A
NAMESPACE NAME READY STATUS RESTARTS AGE
istio-system istio-ingressgateway-7776dd578-w46kz 1/1 Running 0 9s
istio-system istiod-56c76db8bc-r62c5 1/1 Running 0 31s
kube-system coredns-558bd4d5db-qbkjc 1/1 Running 0 31s
kube-system coredns-558bd4d5db-qqdlt 1/1 Running 0 31s
kube-system etcd-seldon-control-plane 1/1 Running 0 33s
kube-system kindnet-7bb92 1/1 Running 0 31s
kube-system kube-apiserver-seldon-control-plane 1/1 Running 0 33s
kube-system kube-controller-manager-seldon-control-plane 1/1 Running 0 33s
kube-system kube-proxy-wllth 1/1 Running 0 31s
kube-system kube-scheduler-seldon-control-plane 1/1 Running 0 33s
local-path-storage local-path-provisioner-547f784dff-m9f4j 1/1 Running 0 31s
kubectl create namespace seldon
namespace/seldon created
kubectl create namespace seldon-system
namespace/seldon-system created
helm install seldon-core seldon-core-operator \
--repo https://storage.googleapis.com/seldon-charts \
--set usageMetrics.enabled=true \
--namespace seldon-system \
--set istio.enabled=true
W1007 15:36:10.388559 53383 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1007 15:36:10.390739 53383 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1007 15:36:10.394855 53383 warnings.go:70] admissionregistration.k8s.io/v1beta1 ValidatingWebhookConfiguration is deprecated in v1.16+, unavailable in v1.22+; use admissionregistration.k8s.io/v1 ValidatingWebhookConfiguration
W1007 15:36:10.844465 53383 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1007 15:36:10.847088 53383 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1007 15:36:10.869446 53383 warnings.go:70] admissionregistration.k8s.io/v1beta1 ValidatingWebhookConfiguration is deprecated in v1.16+, unavailable in v1.22+; use admissionregistration.k8s.io/v1 ValidatingWebhookConfiguration
NAME: seldon-core
LAST DEPLOYED: Thu Oct 7 15:36:09 2021
NAMESPACE: seldon-system
STATUS: deployed
REVISION: 1
TEST SUITE: None
kubectl get validatingwebhookconfigurations
NAME WEBHOOKS AGE
istio-validator-istio-system 2 45s
seldon-validating-webhook-configuration-seldon-system 3 1s
kubectl apply -f - << END
apiVersion: machinelearning.seldon.io/v1
kind: SeldonDeployment
metadata:
name: iris-model
namespace: seldon
spec:
name: iris
predictors:
- graph:
implementation: SKLEARN_SERVER
modelUri: gs://seldon-models/v1.12.0-dev/sklearn/iris
name: classifier
name: default
replicas: 1
END
Error from server (InternalError): error when creating "STDIN": Internal error occurred: failed calling webhook "v1.vseldondeployment.kb.io": Post "https://seldon-webhook-service.seldon-system.svc:443/validate-machinelearning-seldon-io-v1-seldondeployment?timeout=30s": dial tcp 10.96.137.128:443: connect: connection refused
make: [Makefile:15: setup] Error 1 (ignored)
k gets pods -A give this:
NAMESPACE NAME READY STATUS RESTARTS AGE
istio-system istio-ingressgateway-7776dd578-w46kz 1/1 Running 0 2m34s
istio-system istiod-56c76db8bc-r62c5 1/1 Running 0 2m56s
kube-system coredns-558bd4d5db-qbkjc 1/1 Running 0 2m56s
kube-system coredns-558bd4d5db-qqdlt 1/1 Running 0 2m56s
kube-system etcd-seldon-control-plane 1/1 Running 0 2m58s
kube-system kindnet-7bb92 1/1 Running 0 2m56s
kube-system kube-apiserver-seldon-control-plane 1/1 Running 0 2m58s
kube-system kube-controller-manager-seldon-control-plane 1/1 Running 0 2m58s
kube-system kube-proxy-wllth 1/1 Running 0 2m56s
kube-system kube-scheduler-seldon-control-plane 1/1 Running 0 2m58s
kube-system seldon-spartakus-volunteer-5b57b95596-pnxz8 1/1 Running 0 2m22s
local-path-storage local-path-provisioner-547f784dff-m9f4j 1/1 Running 0 2m56s
seldon-system seldon-controller-manager-7b697d587f-wg7sh 1/1 Running 0 2m22s
ukclivecox commented
Can you clarify the OS and Docker you are running on?
There seems to be an issue in the networking which is stopping the k8s api-server calling the mutating webhook.
ucsky commented
yes sure, docker --version give Docker version 20.10.9, build c2ea9bc.
env | grep -ia docker give DOCKER_BUILDKIT=1.
lsb_release -a give
LSB Version: core-11.1.0ubuntu2-noarch:security-11.1.0ubuntu2-noarch
Distributor ID: Pop
Description: Pop!_OS 21.04
Release: 21.04
Codename: hirsute
ukclivecox commented
Can you check their is a k8s service matching the destination seldon-webhook-service.seldon-system and its has a 443 port exposed which connects to the manager? Can you see any errors in the manager logs?
ucsky commented
Sorry I'm not sure how to do this. I checked in lens and I can't see an error on seldon-webhook-service.seldon-system.
Screenshoot here https://ibb.co/1q3V2Qt
Do you known a command line that I can use for checking this?
axsaucedo commented
Just to make sure that the service is configured correctly can you share the services and the -o yaml for the webhook service in seldon-system? ie kubectl get svc -n seldon-system <servicename> -o yaml
axsaucedo commented
Looking at your logs I can see the following:
W1007 15:36:10.388559 53383 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1007 15:36:10.390739 53383 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1007 15:36:10.394855 53383 warnings.go:70] admissionregistration.k8s.io/v1beta1 ValidatingWebhookConfiguration is deprecated in v1.16+, unavailable in v1.22+; use admissionregistration.k8s.io/v1 ValidatingWebhookConfiguration
W1007 15:36:10.844465 53383 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1007 15:36:10.847088 53383 warnings.go:70] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1007 15:36:10.869446 53383 warnings.go:70] admissionregistration.k8s.io/v1beta1 ValidatingWebhookConfiguration is deprecated in v1.16+, unavailable in v1.22+; use admissionregistration.k8s.io/v1 ValidatingWebhookConfiguration
I don't understand how exactly, but it seems like you are still running against a kubernetes 1.22+ cluster, and hence seldon core won't work until #3618 is addressed in the next release.
I can't see any errors but further exploration on this may provide more understanding on what could be different.
axsaucedo commented
Are you sure you are using the cluster that is created with your kind as opposed to a different one? I have a k8s 1.21 kind cluster and I don't get those warnings.
axsaucedo commented
I have just tried again from scratch with istio 1.11 as I had istio 1.10 and I still am not able to replicate, can you share more details on the points above, as well as the logs of the seldon operator (ie kubectl logs -n seldon-system <seldoncontroller>), together with your kind and istioctl binary version? Also running kubectl version to see the versions of the client and server.
ukclivecox commented
I have tried with:
kind version
kind v0.11.1 go1.16.4 linux/amd64
and
helm version
WARNING: "kubernetes-charts.storage.googleapis.com" is deprecated for "stable" and will be deleted Nov. 13, 2020.
WARNING: You should switch to "https://charts.helm.sh/stable" via:
WARNING: helm repo add "stable" "https://charts.helm.sh/stable" --force-update
version.BuildInfo{Version:"v3.7.0", GitCommit:"eeac83883cb4014fe60267ec6373570374ce770b", GitTreeState:"clean", GoVersion:"go1.16.8"}
and
kubectl version
Client Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.1", GitCommit:"c4d752765b3bbac2237bf87cf0b1c2e307844666", GitTreeState:"clean", BuildDate:"2020-12-18T12:09:25Z", GoVersion:"go1.15.5", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.1", GitCommit:"5e58841cce77d4bc13713ad2b91fa0d961e69192", GitTreeState:"clean", BuildDate:"2021-05-21T23:01:33Z", GoVersion:"go1.16.4", Compiler:"gc", Platform:"linux/amd64"}
And it works.
Can you confirm your versions of kind, helm and kubectl?
ucsky commented
Hello,
Kind: kind v0.11.1 go1.16.4 linux/amd64
helm: version.BuildInfo{Version:"v3.6.0", GitCommit:"7f2df6467771a75f5646b7f12afb408590ed1755", GitTreeState:"clean", GoVersion:"go1.16.3"}
kubectl:
Client Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.4", GitCommit:"3cce4a82b44f032d0cd1a1790e6d2f5a55d20aae", GitTreeState:"clean", BuildDate:"2021-08-11T18:16:05Z", GoVersion:"go1.16.7", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.1", GitCommit:"5e58841cce77d4bc13713ad2b91fa0d961e69192", GitTreeState:"clean", BuildDate:"2021-05-21T23:01:33Z", GoVersion:"go1.16.4", Compiler:"gc", Platform:"linux/amd64"}
ukclivecox commented
Closing. Please reopen if still an issue.
pjerryhu commented
I'm running into the same issues. After trying the above methods, there is still no resolutions. Could it be because I'm running locally on my mac with M1 chip?
pjerryhu commented
I'm running into the same issues. After trying the above methods, there is still no resolutions. Could it be because I'm running locally on my mac with M1 chip?
Turned out istioctl install resolved my issue.
CaoHoangTung commented
For me, I forgot to install istio when working with AWS EKS.
Installing istio as the documentation solved the issue
https://docs.seldon.io/projects/seldon-core/en/latest/install/aws.html