Improve script for downloading OA data
Closed this issue · 0 comments
jnu commented
- Add a feature to download an (updated) set of OA data
- Improve ingestion query performance, which will currently be quite bad on even small states
- Add an index to the OA data so that we know which files to extract to find the relevant states we want to ingest.
- Think about how often to schedule updates