docker compose for various setups
This is based on the the hadoop build from local git repo for test/dev environment. You will need to modify the HADOOP_DIST environment variable in .env file to match with your environment. The base OS and tools are based on Elek, Marthon's work for Hadoop and Ozone.
How to use
-
Build to your hadoop, in this case, ~/git/hadoopdev/hadoop cd ~/git/hadoopdev/hadoop mvn ...
-
Change the .env file to match with your enviornment, in this case it is
HADOOP_DIST=~/git/hadoopdev/hadoop/hadoop-dist/target/hadoop-3.1.0-SNAPSHOT
-
Run docker-compose pull to pull the base image docker-compose pull
-
Clean up previous docker-compose containers docker-compose down
-
Spin up the containers docker-compose up -d
-
Check the containers and the port mapping docker ps -a
-
Check the docker container log if you hit any problem spin up all the containers for the services. docker logs
-
Shutdown the containers if have fix the problem and want to restart with step 5. docker-compose down