/s3-datapipe-redshift

Cloudformation - S3 to DataPipeline to Redshift using python lambda trigger

Primary LanguageShell

s3-datapipe-redshift

Cloudformation - S3 to DataPipeline to Redshift using python lambda trigger

Please ensure ansible, awscli, boto and psql are configured. Tested with Ansible 2.3.0, boto3 1.4.4, psql 9.6.2 and awscli 1.11.61.

git clone https://github.com/dmccue/s3-datapipe-redshift.git && cd s3-datapipe-redshift
vi ansible/vars.yml

To create application:
  ./stack_update.sh
  
To delete application
  ./stack_delete.sh

Please see https://cloudwheel.wordpress.com/2017/03/13/aws-cloudformation-for-s3-import-to-redshift-using-datapipeline-lambda/ for a full description