k8s_isi_provisioner

Kubernetes external storage provisioner for Dell Isilon

Based on the following:

Instructions: In order to use this external provisioner, you can use the image pushed to docker hub "tenortim/k8s_isi_provisioner", or build it yourself.

Building

To build this provisioner, ensure you have Go installed. This code requires a minimum of Go 1.11.
To build the software, run make.

Deploying

OpenShift with Templates

This method of creating the resources uses a DeploymentConfig for Pod availablity as well as a Secret for the ISI_PASS.

1. Create namespace

NAMESPACE=k8s-isi-provisioner
oc new-project ${NAMESPACE}

2. Create authentication & authorization resources

The provisioner requires various permissions whether you are running it in raw Kubernetes or in OpenShift. The persistent-volume-provisioner cluster role in OpenShift 3.11 is missing the needed endpoints permissions and so permissions are supplied by auth.yaml for both OpenShift and pure Kubernetes:

Standard Example:

oc project ${NAMESPACE}
oc process -f openshift/auth-template.yaml \
  -p NAMESPACE=${NAMESPACE} \
| oc create -f -

See openshift/auth-template.yaml for full template parameter list and descriptions.

3. Create k8s-isi-provisioner resources

Bare minimum parameters:

oc project ${NAMESPACE}
oc process -f openshift/k8s-isi-provisioner-template.yaml \
  -p ISI_SERVER= \
  -p ISI_PATH= \
  -p ISI_USER= \
  -p ISI_PASS=

Example with STORAGE_CLASS_MOUNT_OPTIONS:

oc project ${NAMESPACE}
oc process -f openshift/k8s-isi-provisioner-template.yaml \
  -p ISI_SERVER=emc-isilon-onefs-simulator-pool0.example.xyz \
  -p ISI_API_SERVER=emc-isilon-onefs-simulator-pool0.example.xyz \
  -p ISI_PATH=/ifs/ocp.example.xyz-pool0 \
  -p ISI_USER=svc-ocp \
  -p ISI_PASS=password \
  -p ISI_QUOTA_ENABLE=TRUE \
  -p PROVISIONER_NAME=isilon-simulator-pool-0 \
  -p STORAGE_CLASS_MOUNT_OPTIONS='["nfsvers=3", "nolock"]'

Example with default reclaimPolicy of Retain:

oc project ${NAMESPACE}
oc process -f openshift/k8s-isi-provisioner-template.yaml \
  -p ISI_SERVER=emc-isilon-onefs-simulator-pool0.example.xyz \
  -p ISI_API_SERVER=emc-isilon-onefs-simulator-pool0.example.xyz \
  -p ISI_PATH=/ifs/ocp.example.xyz-pool0 \
  -p ISI_USER=svc-ocp \
  -p ISI_PASS=password \
  -p ISI_QUOTA_ENABLE=TRUE \
  -p PROVISIONER_NAME=isilon-simulator-pool-0 \
  -p STORAGE_CLASS_RECLAIM_POLICY=Retain

Example for creating two different provisioners for two different isilon pools:

oc project ${NAMESPACE}
oc process -f openshift/k8s-isi-provisioner-template.yaml \
  -p ISI_SERVER=emc-isilon-onefs-simulator-pool0.example.xyz \
  -p ISI_API_SERVER=emc-isilon-onefs-simulator-pool0.example.xyz \
  -p ISI_PATH=/ifs/ocp.example.xyz-pool0 \
  -p ISI_USER=svc-ocp \
  -p ISI_PASS=password \
  -p ISI_QUOTA_ENABLE=TRUE \
  -p PROVISIONER_NAME=isilon-simulator-pool-0
  
oc process -f openshift/k8s-isi-provisioner-template.yaml \
  -p ISI_SERVER=emc-isilon-onefs-simulator-pool1.example.xyz \
  -p ISI_API_SERVER=emc-isilon-onefs-simulator-pool1.example.xyz \
  -p ISI_PATH=/ifs/ocp.example.xyz-pool1 \
  -p ISI_USER=svc-ocp \
  -p ISI_PASS=foobar \
  -p ISI_QUOTA_ENABLE=TRUE \
  -p PROVISIONER_NAME=isilon-simulator-pool-1

See openshift/k8s-isi-provisioner-template.yaml for full template parameter list and descriptions.

Kubernetes or Openshift Using Indvidual Resources

oc create -f kubernetes/auth.yaml

kubectl create -f kubernetes/auth.yaml

To deploy the provisioner, run

oc create -f kubernetes/pod.yaml

kubectl create -f kubernetes/pod.yaml

If you need to create exports in an access zone other than the System zone, set the ISI_ZONE environment variable in pod.yaml.

Create the isilon storage class using the class.yaml file

oc create -f kubernetes/class.yaml

kubectl create -f kubernetes/class.yaml

Note, the NFS mount options that the pod will use are specified at the time that the storage class is created. If additional volume mount options (e.g. forcing NFS version 3) are needed, they can be specified in the class file:

oc create -f kubernetes/class-with-mount-options.yaml

kubectl create -f kubernetes/class-with-mount-options.yaml

Example code to create a persistent volume claim named isilon-pvc:

oc create -f kubernetes/claim.yaml

kubectl create -f kubernetes/claim.yaml

Tested Intigrations

Isilon Version:

8.2.1.0 (https://www.emc.com/products-solutions/trial-software-download/isilon.htm)

OpenShift Versions:

3.11.154

Quotas: This provisioner has support for Isilon Storage Quotas. When enabled, hard, enforcing directory quotas will be created based on the requested size of the volume. The container flag is not currently set so the reported size from 'df' will not reflect the limit, but it will be enforced. This will a require a revision of the goisilon library to support the functionality.

Pod Environment Variables

Param	Description	Example
ISI_SERVER	The DNS name (or IP address) of the Isilon to use for mount requests	isilon.somedomain.com
ISI_API_SERVER	The DNS name (or IP address) of the Isilon to use for API access to create the volume (defaults to ISI_SERVER)	isilon-mgmt.somedomain.com
ISI_PATH	The root path for all exports to be created in	/ifs/ose_exports
ISI_ZONE	The access zone for all exports to be created in (defaults to System)	System
ISI_USER	The user to connect to the isilon as	admin
ISI_PASS	Password for the user account	password
ISI_GROUP	The default group to assign to the share	users
ISI_QUOTA_ENABLE	Enable the use of quotas. Defaults to disabled.	FALSE or TRUE
PROVISIONER_NAME	Alternate name to allow registering multiple providers with different parameters. Defaults to "isilon"	isilon

Thanks

Thanks to the developers of the Kubernetes external storage provisioner code and the docs that are making this possible to do. Thanks to Dell EMC {code} for the great Isilon library.

kinneyjbw/k8s_isi_provisioner