fiaisis/jobcontroller

Investigate spurious error messages in JobController

Closed this issue · 1 comments

I noticed some errors in the JobController logs,

Interestingly, the threads for the JobController JobWatcher class will exist for 6 hours and 404 error? However, they should have terminated as the database entry and all other behaviour is as it should be.

Logs:

HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"pods \"run-mar28620-365c6d1fbfc74b82bb4acae6b3d739c7-tzns9\" not found","reason":"NotFound","details":{"name":"run-mar28620-365c6d1fbfc74b82bb4acae6b3d739c7-tzns9","kind":"pods"},"code":404}

Link to Grafana Logs:
https://isisautoreduction.grafana.net/explore?orgId=1&left=%7B%22datasource%22%3A%22grafanacloud-logs%22%2C%22queries%22%3A%5B%7B%22refId%22%3A%22A%22%2C%22expr%22%3A%22%7Bpod%3D%5C%22jobcontroller-7cdc5db569-hr2px%5C%22%7D+%7C%3D+%6028620%60%22%2C%22queryType%22%3A%22range%22%2C%22datasource%22%3A%7B%22type%22%3A%22loki%22%2C%22uid%22%3A%22grafanacloud-logs%22%7D%2C%22editorMode%22%3A%22builder%22%7D%5D%2C%22range%22%3A%7B%22from%22%3A%221684969200000%22%2C%22to%22%3A%221685141999000%22%7D%7D

No longer necessary