Add cache

[jakobbraun]

Creating so many files is expensive, while only storing them is cheaper.
So let's add a cache that preserves the files.