bentoml/Yatai

Error: get Bento CR bentoes.resources.yatai.ai not found

devJackie opened this issue · 1 comments

devJackie commented

Describe the bug

After deploying from yatai UI, the following error occurs in yatai-deployment log.

In lower versions, other errors related to CRDS occur.
However, in version 1.1.13, the error that occurred in 1.1.9~1.1.12 no longer occurs, and the following error occurs.

yatai-deployment error log :
image

1.689146204559899e+09 ERROR conversion-webhook failed to convert {"request": "65e85fef-9cf3-49b5-a6ea-73856cf0e910", "error": "get Bento CR iris-classifier--0-0-2-iris-classifier: bentoes.resources.yatai.ai "iris-classifier--0-0-2-iris-classifier" not found", "errorVerbose": "bentoes.resources.yatai.ai "iris-classifier--0-0-2-iris-classifier" not found\nget Bento CR iris-classifier--0-0-2-iris-classifier\ngithub.com/bentoml/yatai-deployment/apis/serving/v1alpha3.getBentoTagFromBentoName\n\t/workspace/apis/serving/v1alpha3/bentodeployment_conversion.go:284\ngithub.com/bentoml/yatai-deployment/apis/serving/v1alpha3.(*BentoDeployment).ConvertFrom\n\t/workspace/apis/serving/v1alpha3/bentodeployment_conversion.go:390\nsigs.k8s.io/controller-runtime/pkg/webhook/conversion.(*Webhook).convertObject\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/webhook/conversion/conversion.go:142\nsigs.k8s.io/controller-runtime/pkg/webhook/conversion.(*Webhook).handleConvertRequest\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/webhook/conversion/conversion.go:107\nsigs.k8s.io/controller-runtime/pkg/webhook/conversion.(*Webhook).ServeHTTP\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/webhook/conversion/conversion.go:74\ngithub.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerInFlight.func1\n\t/go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:40\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2109\ngithub.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerCounter.func1\n\t/go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:117\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2109\ngithub.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerDuration.func2\n\t/go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:84\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2109\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2487\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2947\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1991\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1594"}
sigs.k8s.io/controller-runtime/pkg/webhook/conversion.(*Webhook).ServeHTTP
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/webhook/conversion/conversion.go:76
github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerInFlight.func1
/go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:40
net/http.HandlerFunc.ServeHTTP
/usr/local/go/src/net/http/server.go:2109
github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerCounter.func1
/go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:117
net/http.HandlerFunc.ServeHTTP
/usr/local/go/src/net/http/server.go:2109
github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerDuration.func2
/go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:84
net/http.HandlerFunc.ServeHTTP
/usr/local/go/src/net/http/server.go:2109
net/http.(*ServeMux).ServeHTTP
/usr/local/go/src/net/http/server.go:2487
net/http.serverHandler.ServeHTTP
/usr/local/go/src/net/http/server.go:2947
net/http.(*conn).serve
/usr/local/go/src/net/http/server.go:1991

yatai-image-builder log:
image

To reproduce

For installation, refer to the yatai installation guide.
-> https://docs.yatai.io/en/latest/installation/index.html

I read the bentoml quickstart guide and deployed it to the kubernetes environment.
-> https://github.com/bentoml/BentoML/tree/main/examples/quickstart

  1. bentoml login
  2. bentoml build
  3. bentoml push

After push, we proceeded to deploy through yatai UI.

Expected behavior

No response

Environment

  • kubernetes
    -> 1.26.4

  • yatai
    -> yatai-1.1.9
    -> yatai-image-builder-1.1.7
    -> yatai-deployment-1.1.13

devJackie commented

It was a proxy problem inside kubernetes, and we solved(set no_proxy) the proxy problem. sorry. 🥹