kserve/modelmesh-serving

Issues

• [Question] How to implement readinessProbe for custom serving runtime.

  #532 opened 9 days ago by haiminh2001
  0

• Support for mlflow models

  #527 opened 3 months ago by liaspas
  1

• Support for Swagger UI

  #530 opened a month ago by muratyarali
  0

• Cannot view endpoint details on Kubeflow.

  #528 opened 2 months ago by muratyarali
  0

• delete.sh removes both related and unrelated ClusterServingRuntime instances

  #529 opened a month ago by muratyarali
  0

• Quickstart broken: modelmesh-serving svc not created in --namespace-scope-mode: secret "model-serving-etcd" not found

  #519 opened 6 months ago by planetA
  1

• Failed to load model while following the tutorial 'Creating a custom serving runtime in KServe ModelMesh'

  #504 opened 8 months ago by JimBeam2019
  3

• How to Control the Number of Model Replicas in ModelMesh Serving

  #500 opened 9 months ago by michael-nammi
  7

• Excessive unloading of models when loading an additional model

  #455 opened a year ago by Gaddy-BL
  3

• Promote new committers

  #524 opened 5 months ago by ckadner
  6

• ModelNotHereException causing 8 retry iterations exhausted for model

  #523 opened 5 months ago by GolanLevy
  0

• Change release process to update KServe Helm charts based on kustomize build dry-run

  #447 opened a year ago by ckadner
  2

• certificate is not valid for any names, but wanted to match modelmesh-serving

  #522 opened 5 months ago by janekmichalik
  0

• Inference Service is not scaling

  #521 opened 6 months ago by haiminh2001
  0

• Update go-toolset image for modelmesh-serving

  #518 opened 6 months ago by spolti
  1

• Update Go to supported version (1.21)

  #517 opened 6 months ago by spolti
  1

• [Triton] Inference Service with multiple models

  #514 opened 7 months ago by haiminh2001
  0

• TODO: Create architectural decision record issue to summarize why we want to use `latest` images:

  #508 opened 7 months ago by ckadner
  4

• The behavior of `certificate` in StorageSpec is different from Kserve

  #460 opened a year ago by Jooho
  1

• Better documentation around how unloading is triggered

  #511 opened 7 months ago by dsgibbons
  3

• Model Mesh to support azure blob storage as storage option

  #512 opened 7 months ago by mengal12
  0

• storage-secret-config should have the same parameters as Kserve

  #456 opened 7 months ago by VedantMahabaleshwarkar
  11

• InferenceSerivce must have either the storageUri or the storage.path

  #510 opened 7 months ago by gujingit
  0

• Upgrade UBI base images to version 9

  #461 opened a year ago by ckadner
  1

• release: v0.12.0

  #493 opened 10 months ago by israel-hdez
  1

• Upgrade sigs.k8s.io/controller-runtime to 0.15.x version

  #481 opened a year ago by spolti
  8

• Batch Size Error in Modelmesh with Triton Serving Runtime

  #423 opened a year ago by anhquan075
  3

• The Python-Based Custom Runtime with MLServer can not support to deploy a model stored on a Persistent Volume Claim

  #494 opened 9 months ago by zhlsunshine
  0

• No information about how Predictor autoscaling works?

  #434 opened a year ago by rehevkor5
  3

• Add ginkgo cli to be installed as part of the `fvt` make goal.

  #491 opened 10 months ago by spolti
  0

• Models deployed with ModelMesh-Serving get restarted on upgrade

  #486 opened a year ago by vaibhavjainwiz
  3

• Align knative/serving version across Modelmesh repositories

  #483 opened a year ago by spolti
  5

• Stick with a specific version of Kubebuilder and Kustomize

  #489 opened a year ago by spolti
  4

• Triton Inference Server doesn't return any values when using gRPC protocol but RESTful does

  #449 opened a year ago by anhquan075
  2

• Model Loading Requests Contention

  #469 opened a year ago by GolanLevy
  0

• Fail to build Docker develop image.

  #477 opened a year ago by Jooho
  1

• Install fails if latest commit short hash can be parsed as an int

  #472 opened a year ago by ckadner
  1

• Update Go to supported version (1.20)

  #452 opened a year ago by Jooho
  1

• `ClusterStorageContainer` Feature with ModelMesh

  #471 opened a year ago by lampajr
  0

• Create separate FVT workflow to test `--namespace-scope-mode`

  #436 opened a year ago by ckadner
  0

• Add cherry-pick workflow for fixpatch-releases

  #441 opened a year ago by ckadner
  0

• Install script not working on kustimize version `(devel)`

  #427 opened a year ago by janwytze
  0

• Memory leak decoding etcd secrets

  #419 opened a year ago by ckadner
  0

• Add support for initContainers in ServingRuntime spec

  #438 opened a year ago by funbiscuit
  0

• Quickstart broken: `modelmesh-serving` svc not created in `--namespace-scope-mode`, ISVCs never get to `READY` state

  #433 opened a year ago by ckadner
  7

• Improve handling of namespace scoped in-memory resources in the Service Controller

  #431 opened a year ago by tjohnson31415
  0

• EOF error when loading 1GB onnx model

  #430 opened a year ago by janwytze
  1

• `delete.sh` script `resource mapping not found` error

  #420 opened a year ago by rafvasq
  0

• Error "setup-envtest: command not found" when running 'make test'

  #424 opened a year ago by vaibhavjainwiz
  2

• [Question] Handling vast amount of time series as a result of model_name label

  #426 opened a year ago by GolanLevy
  0