/athena-ddl-rds-snapshot

Create Athena table DDL from Amazon RDS Snapshot Export to S3 information json.

Primary LanguageGo

Athena DDL from RDS Snapshot

Create Athena table DDL from Amazon RDS Snapshot Export to S3 information json.

Install

Download binary from github release.

# macOS
$ curl -LO https://github.com/seapy/athena-ddl-rds-snapshot/releases/download/v1.0/macos.tar
$ tar -xvf macos.tar

Usage

Print DDL

$ adrs -i export_tables_info.json \
    -a hoian \
    -s s3://my-export-bucket/prefix/your-database-name/ \
    -t users,articles

Execute DDL to Athena

$ adrs -i export_tables_info.json \
    -a hoian \
    -s s3://my-export-bucket/prefix/your-database-name/ \
    -t users,articles \
    -w primary \
    -e
  • -a, --athenaDB
    • Required. Your athena database name.
  • -s, --s3Prefix
    • Required. Exported snapshot s3 location. include database name. not include table name.
  • -i, --infoPath
    • Required. Table exported information json file location. you can download from s3 exported result.
  • -t, --tables
    • Optional. Table name if you want DDL only some tables. Seprated by comma(,)
  • -e, --execute
    • Optional. Execute sql to Athena (Default false)
    • Required AWS Secret Environment(AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, AWS_REGION)
  • -w, --workgroup
    • Optional.(Required if execute is true) Athena workgroup.