gesiscss/orc

Service degradation due to docker toomanyrequests error

MridulS opened this issue · 1 comments

The service degradation https://notebooks.gesis.org/grafana/d/nDQPwi7mk/node-activity?viewPanel=34&orgId=1&from=1610691341338&to=1610702604704was was due to toomanyrequests error on docker pulls.

From the docker service log (sudo journalctl -fu docker.service)

Jan 15 10:09:58 spko-css-app03 dockerd[2445]: time="2021-01-15T10:09:58.873953109+01:00" level=error
msg="Handler for POST /v1.40/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

This was fixed by doing sudo docker login again on the server, need to figure out a more permanent solution than force logging in again and again (this has happened before too).

This should be taken care by #26 (with DinD).