Does yatai deployment require saving the model to the bentos model store?
xytsinghua opened this issue · 2 comments
xytsinghua commented
In service.py, the pt model file is directly read through the custom runner without saving the model to the bentoml model store.
As a result, yatai cannot be deployed normally because there is no model file. Is there any solution?
parano commented
Hi @xytsinghua - you can use the include
field in bentofile.yaml
to allow the Bento to include your model file. See https://docs.bentoml.com/en/latest/guides/build-options.html#include
xytsinghua commented
Hi @parano
The error screenshot is shown above. I followed your suggestion, but the model file is in the src directory, not in the models directory. yatai deployment still reporting an error that the model file cannot be found.