qurator-spk/eynollah

CI: How to invalidate cache?

kba opened this issue · 2 comments

kba commented

In CircleCI, the python 3.8 builds fail because (I think) the models are cached and now outdated -> bad marshal error solved by #91.

Currently, the cache key is the static string model-cache, i.e. it will never be invalidated. Maybe it should be something like model-cache-<< pipeline.git.branch >>.

cneud commented

I got the cache updated, but now the smoke-test fails due to RAM exhaustion - the Docker executor on CircleCI only has only 4 GB. We could maybe switch to using the machine executor (e.g. ubuntu-2004) which is supposed to have 8 GB.

cneud commented

I had to set the Python version in the machine executor explictely via pyenv, but now the smoke-test passes!

We're all green both on GitHub Actions and CircleCI now for eynollah_light with Python 3.7 & 3.8 🍾