nbtest fails on document chunking notebook
miguelgrinberg opened this issue · 2 comments
miguelgrinberg commented
I'm getting the following error when running the document chunking notebook under nbtest:
ConflictError: ConflictError(409, 'status_exception', 'Trained model deployment [sentence-transformers__all-minilm-l6-v2] is not allocated to any nodes')
This is on a deployment that has never been used with this particular model.
miguelgrinberg commented
Note: a second run on the same deployment suceeded, so this is likely a timing issue.
miguelgrinberg commented
There is a performance issue when running inferences on a recently deployed ML model. We have addressed this issue by configuring a longer request_timeout
.