A CLI tool which collects BigQuery jobs from half a year back.
[
BigQuery jobs could be monitored through Stackdriver Logging(*1), INFORMATION_SCHEMA, or any similar ways. However, neither of these monitoring methods don't fulfill the needs below at onece:
- Monitoring isn't set beforehand
- Need job history older than the last 180 days
BigQueryLogCollector provide simple CLI tool which collects BigQuery job history and options to test and/or store the histories to BigQuery table for analysis use.
| option | description | example |
|---|---|---|
| -a, --append | Store | |
| -d, --dryrun | Display collected job histories but DONOT store them | |
| -i, --infinite | Loop API call until it hits the end | |
| -t, --table_id | Define table_id to store the collected data | |
| -M, --maxCreationTime | Define maxCreationTime to anker the collection start point |