glue-deploy
An opinionated deployment process for AWS Glue.
Deployment Process
This tool targets Glue jobs based on Tags. The goal of this deployment process is to update the command's script location field of a Glue job without making any other changes to the job. This does not update the additional libraries argument, just the main script location.
To target a job for the deployment, the job requires the following two tags and they must match your deployment options:
tag:ArtifactID
- the versioned artifact you are deployingtag:Environment
- the logical environment of said tag
Prequisites
This deployment process assumes specific tags have been added to your Glue jobs. Please read through the deployment process above.
Usage
Download the build for your machine, unzip, and add to your $PATH
.
Run glue-deploy --help
to view available commands
An opinionated deployment process for AWS Glue
Usage:
glue-deploy [flags]
Flags:
-a, --artifact-id string id artifact to deploy
-v, --artifact-version string artifact version to set
--auto-approve automatically approve version changes
-e, --environment string target deployment environment
-h, --help help for glue-deploy
-r, --role string (optional) an IAM role ARN to assume before invoking a deployment
--version version for glue-deploy
Example:
glue-deploy --environment qa --artifact-id myapp --artifact-version latest
TODO:
- provide IAM requirements
- consider updating or setting the
--additional-python-modules
argument - support color output
- s3 validation
- persist version in SSM