bcgov/nr-rfc-processing

Add Data Persistence Step

Closed this issue · 1 comments

Create Persistence Script

When the script executes in a github action all the data generated will be discarded after the script runs.

This task will add code that will replicate the data created by the daily pipeline up to object storage.

Currently thinking this would be a process that is run after the dailypipeline is run

Dug up the config that was used to complete the archive of locally stored archived snowpack data. That same process can be used to backup the data generated through a github action. For config see the readme in the snowpack_archive directory. Deploying it will require:

a) installing the dependencies
b) configure env var defined in the readme.md in the snowpack_archive folder
c) run the script.

The rest of this task will get completed with the implementation of the GHA and issue: #35