Helioviewer-Project/jp2gen

Add jobs to look automatically fill in missing data.

Opened this issue · 0 comments

Users have noted that some data sources are missing data, sometimes an entire day and sometimes an entire month. This can be ameliorated by running processes that regularly look back over longer periods of time to check for data that may not have converted into JPEG2000 images.

This can be done with some small changes to the JPEG2000 creation scripts. Typically these search for data once every X hours, looking for data between the current time and Y days ago. Additional jobs can be added that search less frequently but further back. For example, we can have jobs that check once every day (X=24), but check a full week back in time (Y=7). Similarly, we should have jobs that check once every week (X=168), but check back in time four weeks (Y=28). This should be applied to all JPEG2000 creation processes running at GSFC for operating missions.