Use /stats endpoint to check which models are running in the "request" service
Closed this issue · 0 comments
JadenFiotto-Kaufman commented
Right now, the request services checks if the model youve requested is running via looking at the rabbitmq queues. This is bad because a node can go down but the queue still might be up. It should probably check via the /stats endpoint from the api.