Write validation scripts for data before pushing to s3
lxu213 opened this issue · 3 comments
lxu213 commented
Geoid files
-
Validate total number of geoid files is expected: county number + state number
-
Validate first key in geoid file (06085.json) is run_date. No period, semicolon, colon, etc in key.
-
Validate next key can only be low, med or high
-
Validate object includes name, max, over, r0, and vals
-
Validate length of vals is same as overall length of dates
-
Validate indicators only includes expected incidI, incidH, etc from outcomes.json
statsForMap
-
Validate state key is first, and then county key
-
Validate scenario_name matches geoid scenario_name
-
Keys are exactly as expected - from outcomes.json
countyBoundaries
- Check stats exists in statsForMap and countyBoundaries
Actuals files
-
Validate number of expected actuals files
-
Contains expected reported data
Requested Feature
- Run and test validator on just one geoid
veev commented
Include validation for dateThreshold in scenario name key