canonical/seldon-core-operator

Seldon <=1.15 does not support k8s 1.25+

ca-scribner opened this issue · 6 comments

The k8s autoscaling/v2beta1 API has been migrated to v2, causing this issue in Seldon and blocking Seldon <=1.15 from using k8s 1.25+. Seldon 1.16 will fix this and support k8s 1.25+.

v2beta2 is still available in 1.25

maybe there is another issue?

image

hmm i haven't tested it myself, but there was enough activity on that thread to think it correct. We could give it a try and see

@ca-scribner
ok, I see

you did a typo in your description, it is the first version of beta, not second

autoscaling/v2beta1

which is indeed removed in 1.25

fixed in description to avoid confusion in future

Tested and confirmed the issue on microk8s 1.25
seldon-core 1.15/stable

Status:
  Address:
    URL:  http://iris-model-default.admin.svc.cluster.local:8000/api/v1.0/predictions
  Conditions:
    Last Transition Time:  2023-07-21T09:41:01Z
    Reason:                Not all services created
    Status:                False
    Type:                  Ready
    Last Transition Time:  2023-07-21T09:41:01Z
    Reason:                Not all services created
    Status:                False
    Type:                  ServicesReady
  Description:             no matches for kind "HorizontalPodAutoscaler" in version "autoscaling/v2beta1"
  State:                   Failed
Events:
  Type     Reason         Age                   From                       Message
  ----     ------         ----                  ----                       -------
  Normal   CreateService  4m24s                 seldon-controller-manager  Created Service "iris-model-default-classifier"
  Normal   CreateService  4m24s                 seldon-controller-manager  Created Service "iris-model-default"
  Warning  UpdateFailed   4m19s                 seldon-controller-manager  Failed to update status for SeldonDeployment "iris-model": Operation cannot be fulfilled on seldondeployments.machinelearning.seldon.io "iris-model": the object has been modified; please apply your changes to the latest version and try again
  Warning  InternalError  78s (x16 over 4m22s)  seldon-controller-manager  no matches for kind "HorizontalPodAutoscaler" in version "autoscaling/v2beta1"

After Noha's confirmation we are closing this issue since Seldon 1.15 is not working with K8s 1.25.

CKF 1.8 should be able to run on K8s 1.25 since it will use Seldon 1.17