Add Data Persistence Step
Closed this issue · 1 comments
Create Persistence Script
When the script executes in a github action all the data generated will be discarded after the script runs.
This task will add code that will replicate the data created by the daily pipeline up to object storage.
Currently thinking this would be a process that is run after the dailypipeline is run
Dug up the config that was used to complete the archive of locally stored archived snowpack data. That same process can be used to backup the data generated through a github action. For config see the readme in the snowpack_archive
directory. Deploying it will require:
a) installing the dependencies
b) configure env var defined in the readme.md
in the snowpack_archive folder
c) run the script.
The rest of this task will get completed with the implementation of the GHA and issue: #35