allegroai/clearml-serving
ClearML - Model-Serving Orchestration and Repository Solution
PythonApache-2.0
Issues
- 0
- 4
triton model breaks serving instance
#60 opened by stephanbertl - 0
Deploy YOLOv8 Segmentation model
#77 opened by Flippchen - 2
torchserve support?
#64 opened by k-sokolov - 2
- 3
- 2
Shared functions across preprocess file
#68 opened by amirhmk - 0
- 1
- 0
Multiple TensorRT handling(plan file per gpu)
#70 opened by TDNAI - 3
- 1
Removing model monitoring in endpoint
#69 opened by imadassamani - 4
- 0
serving stuck because of deleted model
#65 opened by stephanbertl - 1
Docker image not up-to-date
#63 opened by amirhmk - 13
- 7
Unable to load onnx models into Triton
#53 opened by amirhmk - 2
- 3
Configure options for gRPC (Triton server)
#49 opened by amirhmk - 2
ValueError: dictionary update sequence element #0 has length <>; 2 is required
#61 opened by IlyaMescheryakov1402 - 2
- 1
Error: Failed loading preprocess code for '<>': No module named 'transformers'
#56 opened by IlyaMescheryakov1402 - 1
String not supported for Triotn
#54 opened by amirhmk - 7
AWS S3 storage driver (boto3) not found
#39 opened by vladseve7n - 3
Unable to canonicalize address from Kafka
#44 opened by amirhmk - 1
Issue with pytorch preprocess code
#38 opened by okyspace - 2
Incorrect shape size PyTorch
#48 opened by amirhmk - 4
clearml-serving not working with newer numpy 1.24
#41 opened by cajewsa - 5
Deploying Models from Azure Blob
#43 opened by ockaro - 2
better explanation of the scalar type and buckets
#40 opened by besrym - 2
- 4
Error triton helper file
#15 opened by NurrahmiM - 2
- 13
Support for already Running Triton
#13 opened by okyspace - 8
Add on for README
#12 opened by okyspace - 6
Serving Scikit-Learn models
#11 opened by suparnaj3 - 4
Behavior of published model
#8 opened by okyspace - 4
Managing published versions
#7 opened by okyspace - 6
Triton cannot find downloaded model
#6 opened by ecm200 - 3
Triton server keeps crashing
#36 opened by Aleksandar1932 - 1
- 2
Serving autoscaling strategy
#34 opened by senysenyseny16 - 2
add aux-config parser error
#30 opened by andycancado - 3
Serving with custom engine
#33 opened by Bunoviske - 4
Endpoint authorization with API key
#32 opened by Bunoviske - 2
docker-compose-triton-gpu fails due to "PTX was compiled with an unsupported toolchain"
#29 opened by rg314 - 8
ClearML serving design v2
#17 opened by bmartinn - 6
- 2
Request for unknown model: 'test_model_pytorch' version 1 is not at ready state
#22 opened by takumi5757 - 8
Take model from clearml server via API
#19 opened by calvinshalim