confluentinc/ccloud-tools

502 Bad Gateway for all components (Control Center, Kafka Connect) after applying terraform script

JustinMoser opened this issue · 2 comments

Hi,
We are a recent Confluent Cloud customer and I have successfully deployed the Confluent Platform tools from this repo onto AWS EC2 (Ubuntu) using the steps in your Readme, resulting in this output after applying the Terraform script:

Bastion_Server = ssh ec2-user@REDACTED -i cert.pem
Control_Center = http://control-center-ccloud-tools-REDACTED.eu-west-2.elb.amazonaws.com
KSQL_Server = http://ksql-server-ccloud-tools-REDACTED.eu-west-2.elb.amazonaws.com
Kafka_Connect = http://kafka-connect-ccloud-tools-REDACTED.eu-west-2.elb.amazonaws.com
REST_Proxy = http://rest-proxy-ccloud-tools-REDACTED.eu-west-2.elb.amazonaws.com

However, when I navigate to any of those urls I receive a 502 Bad Gateway response.

Is this the desired output? Im not sure how to go about accessing any of these tools.

I tried (for instance):

curl -sX GET "http://ksql-server-ccloud-tools-REDACTED.eu-west-2.elb.amazonaws.com/info"

and I still receive a 502 Error.

Any ideas if I am doing something wrong? Additionally, the topics that should be created by Control Center when it starts, as listed at this link:

https://docs.confluent.io/current/cloud/connect/c3-cloud-config.html

Are not listed when running ccloud kafka topic list

It seems as though none of the Cloud Tools have initialised properly...

EC2 SysLogs:

57531] cloud-init[1755]: 489800K .......... .......... .......... .......... .......... 94%  348M 1s
[   44.957689] cloud-init[1755]: 489850K .......... .......... .......... .......... .......... 94%  344M 1s
[   45.214409] cloud-init[1755]: 497050K .......... .......... .......... .......... .......... 95%  281M 1s
[   45.278540] cloud-init[1755]: 500250K .......... .......... .......... ..........[   45.327754] serial8250: too much work for irq4
 .......... 96%  338M 1s
[   45.330625] cloud-init[1755]: 500300K .......... .......... .......... .......... .......... 96%  438K 1s
[   45.879037] cloud-init[1755]: 517900K .......... .......... .......... .......... .......... 99%  270M 0s
[   45.879249] cloud-init[1755]: 517950K ....                                                  100% 9032G=18s
[   45.879460] cloud-init[1755]: 2019-09-20 13:39:15 (28.2 MB/s) - ‘confluent-5.2.1-2.12.zip’ saved [530385649/530385649]
[   45.879664] cloud-init[1755]: /var/lib/cloud/instance/scripts/part-001: line 14: unzip: command not found
[   45.879872] cloud-init[1755]: mv: cannot stat 'confluent-5.2.1': No such file or directory
[   45.880295] cloud-init[1755]: mkdir: cannot create directory ‘/etc/confluent/confluent-5.2.1/etc/kafka-connect’: No such file or directory
[   45.919161] cloud-init[1755]: /var/lib/cloud/instance/scripts/part-001: line 21: cd: /etc/confluent/confluent-5.2.1/etc/kafka-connect: No such file or directory
[   45.927380] cloud-init[1755]: Created symlink /etc/systemd/system/multi-user.target.wants/kafka-connect.service → /lib/systemd/system/kafka-connect.service.
[�[0;32m  OK  �[0m] Started Kafka Connect.

[   46.128061] cloud-init[1755]: Cloud-init v. 19.1-1-gbaa47854-0ubuntu1~18.04.1 running 'modules:final' at Fri, 20 Sep 2019 13:38:56 +0000. Up 27.26 seconds.
[   46.128136] cloud-init[1755]: Cloud-init v. 19.1-1-gbaa47854-0ubuntu1~18.04.1 finished at Fri, 20 Sep 2019 13:39:16 +0000. Datasource DataSourceEc2Local.  Up 46.11 seconds
[�[0;32m  OK  �[0m] Started Execute cloud user/final scripts.
[�[0;32m  OK  �[0m] Reached target Cloud-init target.

FYI anyone facing this issue:

This was caused by using the Ubuntu Server AMI instead of the Amazon Linux 2 AMI.