Sidekick unable to submit jobs to Minio cluster
mmonro opened this issue · 2 comments
mmonro commented
Spark jobs submitted to a minio cluster using sidekick began failing, when we turned logging on we observed the following errors in the sidekick container logs:
sidekick: Listening on :9000
http://host1:9000 is down : %!s()
http://host2:9000 is down : %!s()
http://host3:9000 is down : %!s()
http://host4:9000 is down : %!s()
We were able to manually submit jobs directly to all of the minio nodes fine so minio itself was working, but sidekick's basic host check wasn't functioning correctly.
Bouncing the minio services resolved the issue
harshavardhana commented
Added additional logging in 9a1e96d - please check with the latest v0.1.5 release
harshavardhana commented
Closing this issue, as this has been figured out as a network issue.