SeldonIO/MLServer

Issues

• Schema enforcement error when using `PandasCodec` inference request

  #1625 opened 3 months ago by mfueller
  2

• Add support for Pydantic V2

  #1419 opened 23 days ago by stephen37
  10

• Unable to use `tritonclient.grpc`

  #1730 opened a month ago by tokoko
  4

• Add support for nan values in PandasCodec

  #1747 opened a month ago by Pappol
  0

• Dockerfile has a conda version which is incompatible with Conda Lib Mamba

  #1719 opened a month ago by ramonpzg
  0

• tritonclient dependency change - cuda-python cause poetry installation failure in MacOS

  #1382 opened 9 months ago by liusha-H
  5

• Shape in custom json example incorrect

  #1718 opened a month ago by patrickhuy
  0

• Docs specify Pandas DataFrame Codec input shapes incorrectly.

  #1678 opened 2 months ago by ReveStobinson
  0

• Does MLServer support Skops?

  #1676 opened 2 months ago by yc2984
  0

• Inference parameters are not passed to the predict function in MLFlow runtime

  #1660 opened 2 months ago by Okamille
  0

• pydantic.errors.PydanticImportError: `BaseSettings` has been moved to the `pydantic-settings` package

  #1594 opened 3 months ago by harupy
  2

• gRPC async server looses track of `_futures`

  #1652 opened 2 months ago by peter-resnick
  0

• where InferenceRequest init?

  #1650 opened 2 months ago by lanzhiwang
  0

• [BUG]: Kafka Message cannot be serialized to JSON when dict contains bytes

  #1621 opened 3 months ago by DerTiedemann
  1

• Select GPU to be used for each worker on parallel inference

  #1570 opened 4 months ago by teddy-ambona
  0

• Adaptive batching leads to parameters being cut off

  #1541 opened 5 months ago by tobbber
  5

• Can't get metrics: `ValueError: env prometheus_multiproc_dir is not set or not a directory`

  #1566 opened 4 months ago by mrbazzik
  1

• `mlserver build` fails if requirements.txt includes a git path

  #1562 opened 4 months ago by isaac-smothers
  0

• InferenceRequests with Tensor of Tensors does not decode properly

  #1542 opened 4 months ago by GDegrove
  0

• ML Server with GRPC

  #1523 opened 5 months ago by Haritima-Manchanda
  0

• gRPC fails with inferred f16 numpy array

  #1522 opened 5 months ago by sauerburger
  1

• Examples/clarification over using OpenTelemetry tracing in MLServer

  #1513 opened 6 months ago by danielsoutar
  0

• Install `fugashi`, `unidic`, `unidic-lite`, and `ipadic` as dependencies to MLServer HuggingFace to support hosting Japanese language models

  #1506 opened 6 months ago by jbauer2718
  3

• Allow payload request to support extra inference method kwargs

  #1345 opened 9 months ago by nanbo-liu
  6

• Ability to serve swagger doc dependencies from the mlserver instance or use a custom CDN

  #1470 opened 7 months ago by ichbinjakes
  0

• Mlserver timeout for long requests

  #1468 opened 7 months ago by samuel-sujith
  2

• Python version mismatch after loading a Conda env

  #1461 opened 7 months ago by GDegrove
  1

• OpenNMT CTranslate2 Support?

  #1432 opened 8 months ago by cccs-km
  2

• Allow huggingface model's from_pretrained kwargs in the model-setting.json?

  #1344 opened 7 months ago by nanbo-liu
  1

• MLServer > 1.1.0 cannot be installed on a Mac

  #1439 opened 7 months ago by amoldavsky
  1

• InferencePool should respawn dead workers

  #1431 opened 8 months ago by chiragjn
  1

• Add support for `CatBoostRegressor`

  #1429 opened 8 months ago by krishanbhasin-gc
  0

• Add inference params support to MLFlow's custom invocation endpoint

  #1374 opened 8 months ago by M4nouel
  1

• MLServer Huggingface example fails

  #1401 opened 8 months ago by cccs-km
  1

• Enable PandasCodec.decode_request to restore the exact dataframe

  #1390 opened 9 months ago by ysk24ok
  0

• Extend `get_model_uri` to search over all model filenames with a given suffix

  #1367 opened 9 months ago by ascillitoe
  0

• Release patch version to fix security issues?

  #1361 opened 9 months ago by jlopezpena
  1

• TypeError: To define root models, use `pydantic.RootModel` rather than a field called '__root__'

  #1355 opened 9 months ago by meghanapechetti
  2

• Adding IntCodec?

  #1323 opened 9 months ago by rlleshi
  3

• How can i load model from s3, minio or gs storage through uri?

  #1343 opened 9 months ago by whoisltd
  1

• [huggingface] Merge predictive unit parameters from env with model settings

  #1329 opened 9 months ago by vtaskow
  0

• Invalid GID causes permissions issues

  #1335 opened 10 months ago by adriangonz
  0

• Enable consuming from a Kafka topic as a ConsumerGroup

  #1309 opened 10 months ago by ichbinjakes
  2

• Load model in sequential mode when there is more than 1 parallel worker

  #1316 opened 10 months ago by josemalope
  1

• Asyncio Key Error Under Load

  #1312 opened 10 months ago by edfincham
  1

• Adaptive Batching not working as expected

  #1306 opened 10 months ago by sowmyay
  6

• Input encoding failed for string type colume in pandas.DataFrame

  #1313 opened 10 months ago by jinserk
  1

• Issue with models that needs trust_remote_code

  #1303 opened 10 months ago by rivamarco
  0

• Move conda resolver to libmamba

  #1297 opened a year ago by dtpryce
  1

• Improve loading of white-box explainers' models, and add catboost support

  #1287 opened a year ago by ascillitoe
  0