Create a process to backfill `all` tables from HARs older than March 2022
giancarloaf opened this issue · 0 comments
giancarloaf commented
There are some attributes necessary for the pipeline to function properly that are only available in recent HARs (i.e. March 2022 and on).
We will need a methodology to backfill older tables on request.
A suggestion from @rviscomi - this might include nulling out fields where the necessary data is missing from HARs, and supplementing from the historical tables.
Reference this method used previously for generating all.pages from legacy tables.
#15 (comment)
Originally posted by @rviscomi in #136 (comment)