m-lab/etl-gardener
Gardener provides services for maintaining and reprocessing mlab data.
GoApache-2.0
Issues
- 0
Document steps to add new datatype
#430 opened by robertodauria - 2
Flexible configuration - specify output tables through configuration - versioned tables
#349 opened by stephen-soltesz - 0
- 0
- 1
Titia
#413 opened by Ibsadhaeeyee - 2
Interactive jobRateLimitExceeded errors prevent daily jobs from completing
#410 opened by stephen-soltesz - 1
- 0
Enable daily only pcap processing after one historical reprocessing cycle
#389 opened by stephen-soltesz - 1
- 2
Production data types have 'max-min' parse times older than historical cycle time
#381 opened by stephen-soltesz - 0
Do not log non-error messages to stderr
#376 opened by SaiedKazemi - 0
Confirm obsolete documentation
#373 opened by stephen-soltesz - 5
- 2
- 3
- 0
Rename .*Count metrics to .*Total
#356 opened by cristinaleonr - 0
- 0
Feature: Audit table, and versioned job summary files in etl-mlab-* type-date paths
#332 opened by gfr10598 - 6
Adjust node pools in data-processing clusters
#330 opened by gfr10598 - 0
- 0
- 0
- 0
Delete json row files in etl-mlab-xxx after successfully loading into bigquery
#320 opened by gfr10598 - 6
Deploy new gardener and k8s etl parser to prod
#305 opened by gfr10598 - 3
Server location annotations should be based on site info, not on IP geolocation
#319 opened by critzo - 2
- 0
Migrate to a prerequisite driven system
#316 opened by gfr10598 - 0
- 0
Record query cost metrics on failures, if possible
#315 opened by gfr10598 - 0
ETL could add meta-data to GCS json output files, to facilitate Gardener monitoring.
#310 opened by gfr10598 - 0
Develop standard dashboard for universal gardener
#309 opened by gfr10598 - 0
- 0
Feature: Check for contents of archive prefix before dispatching to ETL parser.
#302 opened by gfr10598 - 0
ndt5 Load from GCP has inconsistent test_id string
#294 opened by gfr10598 - 0
DML limited to 20 outstanding requests per table.
#293 opened by gfr10598 - 1
New job-service "yesterday" feature is not working
#289 opened by gfr10598 - 1
Normalize maxmind geo1 and geo2 "region" data
#281 opened by stephen-soltesz - 0
BQ load from GCS encountering errors
#291 opened by gfr10598 - 1
Strange BigQuery behavior
#276 opened by gfr10598 - 0
Short term plan, May 2020
#274 opened by gfr10598 - 2
Some jobs aren't matching in tracker
#252 opened by gfr10598 - 1
- 1
k8s job-service should prioritize yesterday
#260 opened by gfr10598 - 1
Table updates started failing
#272 opened by gfr10598 - 0
Additional BQ steps
#259 opened by gfr10598 - 1
Duplicate UUIDs in base_tables
#254 opened by mattmathis - 0
- 1
- 1
Bigquery exceptions
#224 opened by gfr10598 - 5
Daily processing data not found in BQ
#215 opened by stephen-soltesz