replicate/keepsake

Handle repositories that get updated while an experiment is still running

bfirsh opened this issue · 0 comments

From this discussion: https://github.com/replicate/replicate/pull/408#discussion_r551705523

If a future repository gets updated while an experiment is running (i.e. version in repository.json gets updated), then that experiment might break the repository.

Maybe checkpoints and heartbeats should check the version on write, instead of just when experiment is created?