Searcher fails to answer probe fast enough.
Opened this issue · 1 comments
fulmicoton commented
As identified on airmail...
(It could be the disk cache loading. We probably need to have two level startup like we do for ingesters.)
fulmicoton commented
Right now we have a readiness and a liveness probe. We also do not have any startup probe.
The readiness probe relies on what is advertise on the cluster.
The liveness probe checks the indexing service and the janitor if any, by ask
them an adhoc message called Healthz
.
A node readiness reporting tasks polls a bunch of conditions and updates the READINESS key of the self cluster state.