bentoml/Yatai

Does yatai deployment require saving the model to the bentos model store?

xytsinghua opened this issue · 2 comments

In service.py, the pt model file is directly read through the custom runner without saving the model to the bentoml model store.
As a result, yatai cannot be deployed normally because there is no model file. Is there any solution?

Hi @xytsinghua - you can use the include field in bentofile.yaml to allow the Bento to include your model file. See https://docs.bentoml.com/en/latest/guides/build-options.html#include

Hi @parano
WX20240227-140749
The error screenshot is shown above. I followed your suggestion, but the model file is in the src directory, not in the models directory. yatai deployment still reporting an error that the model file cannot be found.