how to deploy with cutom-runner
johnwayne19860314 opened this issue · 1 comments
johnwayne19860314 commented
the company's project is using yolov5 and deep sort models. we did not store these two model in bentoml model store, but call them by self-defining a runner which inherit the bentoml.Runnable. it is ok to start by calling the command of bentoml serve. but cannot push and deploy in yatai for there is no mode stored and pushed.
Could anyone inform how to store these models in the format of bentoml ? or bentoml can only work on single stored model and not on multi-model project?
parano commented
Hi @johnwayne19860314 , two ways you can do that in BentoML:
- use
include
: https://docs.bentoml.com/en/latest/guides/build-options.html#include - save a custom model: https://docs.bentoml.com/en/latest/guides/model-store.html#save-a-model