/cloudera-quickstart-docker-compose

Setting up a single node Cloudera Hadoop on cloud with quickstart image, docker and docker compose

MIT LicenseMIT

cloudera-quickstart-docker-compose

Setting up a single node Cloudera Hadoop on cloud with quickstart image, docker and docker compose

Getting Things Ready

First, it is necessary to have Docker and Docker compose running on your OS.

Installing Docker

  • Update yum repositories
    sudo yum check-update
  • Get and execute installation script of Docker
    curl -fsSL https://get.docker.com/ | sh
  • Start Docker, verify its status and make it available upon boot
    sudo systemctl start docker
    sudo systemctl status docker
    sudo systemctl enable docker
  • An optional step: If you would like to run "docker" command without sudo, do the following (replace username with yours)
    sudo usermod -aG docker username
  • Status should be similar to below
    alt text

Installing Docker Compose

  • Get epel repositories and install PIP
    sudo yum install epel-release
    sudo yum install -y python-pip
  • Install Docker Compose with PIP
    sudo pip install docker-compose
    sudo pip install docker-compose --ignore-installed (in case you're running pip 10)
  • Update python and PIP
    sudo yum upgrade python*
    sudo pip install --upgrade pip

Setting up Single Node Cloudera Hadoop with Docker Compose

Start up Cloudera Manager

Having installation completed, Cloudera Manager is still disabled and it is better to enable it. Here is the simple guide for enabling Cloudera Manager

  • List the quickstart container and attach to it
    docker ps
    docker attach container-id
  • Execute following command in container for enabling Cloudera Manager. It will take couple of minutes to be completed
    /home/cloudera/cloudera-manager --express
    alt text
  • When CM is being started, it stops all services. Hence it is necessary to restart them all over Cloudera Manager alt text

and We're done! Single node Cloudera Hadoop is ready for use

alt text