🚀Docker environment mainly used for Flink development, including Hadoop /hive/kafka/mysql
By default, Flink uses hive-Catalog, so hive is installed here. Hive uses mysql as an external data store, so mysql is used here.
Where flink-job is the task where a sink is written to mysql.
./download.sh allYou can modify some of the environment variable parameters by modifying the .env file, which will be recognized by docker-compose.
Because the internal and external network is configured to the two networks. So kafka's network can be directly linked to your local Flink for local development. (But you need to add hosts to your local)
echo "127.0.0.1 kafka1 kafka2 kafka3 kafka4" >> /etc/hostsdocker-compose up