elastic/elasticsearch-labs

nbtest fails on document chunking notebook

miguelgrinberg opened this issue · 2 comments

I'm getting the following error when running the document chunking notebook under nbtest:

ConflictError: ConflictError(409, 'status_exception', 'Trained model deployment [sentence-transformers__all-minilm-l6-v2] is not allocated to any nodes')

This is on a deployment that has never been used with this particular model.

Note: a second run on the same deployment suceeded, so this is likely a timing issue.

There is a performance issue when running inferences on a recently deployed ML model. We have addressed this issue by configuring a longer request_timeout.