/cmapi

Cloudera Manager CM API Python end-to-end example

Primary LanguagePythonApache License 2.0Apache-2.0

usage: cmxDeploy.py -u "root" -p "cloudera" -m "CM-SERVER-IP" -w "ip1,ip2,ip3,..."

pre-requisite

You have a running Cloudera Manager Server. You can use the preferred option as documented in ["Installation Path B - Manual Installation Using Cloudera Manager Packages"] 1. And also Cloudera Manager API python (cm-api) client installed 2

TL;DR: copy-and-paste below example in RHEL/CentOS

curl -L https://raw.githubusercontent.com/gdgt/cmapi/master/bootstrap-cm.sh | bash
yum install -y git python-pip python-setuptools
git clone https://github.com/cloudera/cm_api.git -b cm5-5.16.2 $HOME/cm_api && pip install $HOME/cm_api/python
curl -L https://raw.githubusercontent.com/gdgt/cmapi/master/cmxDeploy.py -o $HOME/cmxDeploy.py && chmod +x $HOME/cmxDeploy.py
python $HOME/cmxDeploy.py -u "root" -p "cloudera" -m "$(hostname -f)" -w "$(hostname -f)"
# OR python $HOME/cmxDeploy.py -u "root" -p "cloudera" -m "cm-ip" -w "ip1,ip2,ip3,..."
  • SSH credentials - this allows CM to configure the rest of the hosts -u/--ssh-root-user, -p/--ssh-root-password OR -k/--ssh-private-key
  • create Hive in embedded PosgreSQL database, bash script provided below (also included in bootstrap-cm.sh).

Usage

Usage: cmxDeploy.py [options]

Options:
  -h, --help            show this help message and exit
  -d TEARDOWN, --teardown=TEARDOWN
                        Teardown Cloudera Manager Cluster. Required arguments
                        "keep_cluster" or "remove_cluster".
  -i CDH_VERSION, --cdh-version=CDH_VERSION
                        Install CDH version. Default "latest"
  -k SSH_PRIVATE_KEY, --ssh-private-key=SSH_PRIVATE_KEY
                        The private key to authenticate with the hosts.
                        Specify either this or a password.
  -l LICENSE_FILE, --license-file=LICENSE_FILE
                        Cloudera Manager License file name
  -m CM_SERVER, --cm-server=CM_SERVER
                        *Set Cloudera Manager Server Host. Note: This is the
                        host where the Cloudera Management Services get
                        installed.
  -n CLUSTER_NAME, --cluster-name=CLUSTER_NAME
                        Set Cloudera Manager Cluster name enclosed in double
                        quotes. Default "Cluster 1"
  -p SSH_ROOT_PASSWORD, --ssh-root-password=SSH_ROOT_PASSWORD
                        *Set target node(s) ssh password..
  -u SSH_ROOT_USER, --ssh-root-user=SSH_ROOT_USER
                        Set target node(s) ssh username. Default root
  -w HOST_NAMES, --host-names=HOST_NAMES
                        *Set target node(s) list, separate with comma eg: -w
                        host1,host2,...,host(n). Note: - enclose in double
                        quote. -
                        CM_SERVER excluded in this list, if you want install
                        CDH Services in CM_SERVER add the host to this list.

References