josephmachado/beginner_de_project

aws redshift not created

Closed this issue · 6 comments

@shivnarayanan It looks like redshift cluster is created, but the problem is with Airflow webserver docker container. Can you

  1. Check if Redshift cluster is created in AWS UI?
  2. Check if the webserver and scheduler containers are running using docker ls
  3. Make sure your docker setting has at least 4GB memory.

LMK

image

@josephmachado Hello! I just realised I receive this error halfway through. Have I done something wrong?

@shivnarayanan Could you please check if your docker setting has at least 4GB memory ?

You need to check airflow-webserver1 of docker container and airflow-webserver1 of setup_infra.sh. setup_infra.sh written beginner_de_project_airflow_webserver_1.

image

@shivnarayanan
The container name is incorrect in the old script setup_infra.sh
It should be beginner_de_project-airflow-webserver-1, but the one in the script is beginner_de_project_airflow-webserver_1. Difference being that "_" should be "-". I had the same errors and fixed it by doing this.

@shivnarayanan I put up a fix for this, can you pull master branch and try again?