The Role is added to K8s cluster availability to use in POD deployment RDMA devices for Apps with Native InfiniBand.
- Kubernetes cluster is deployed by Kubespray
- Separate InfiniBand fabric with enabled port virtualization support in Subnet manager
- NVIDIA Mellanox ConnectX-4/5/6 network interface card in InfiniBand mode
The Role is required an additional InfiniBand fabric for POD's with Native InfiniBand network interfaces. For assistance in designing the scaled InfiniBand fabric topology please use the Mellanox InfiniBand Cluster Configurator. It is an online cluster configuration tool that offers flexible cluster sizes and options.
The settable variables for the Role must be provided in roles/mlnx-hca-shared/vars/main.yml.
Mellanox OFED and Kubeflow MPI-Operator are an optional installation components.
During the installation process the Role used host configuration file of Kubespray config/inventory for deployment and provisioning the Kubernetes components.
Copy Role deployment files (playbook, configuration and deployment staff) to your Kubespray deployment folder. Configure the Role variables and execute:
With root user:
# ansible-playbook -i inventory/mycluster/hosts.yaml mlnx-hca-shared.yaml
With standard user:
$ ansible-playbook -i inventory/mycluster/hosts.yaml --become --become-user=root mlnx-hca-shared.yaml
The execution time for this step may take a while to finalize.
BSD
author: Vitaliy Razinkov
company: NVIDIA, Networking business unit