cluster-lifecycle-e2e

An e2e test lib for cluster lifecycle

This is a container which will be called from:

Canary Tests

This will be called after ACM is installed.

The tests in this container will:

Provision aws, gcp, azure cluster
- Create necessary resources to provision cluster
- monitor cluster and add-ons to be in ready state
- destroy cluster
- monitor deletion of clusterdeployment and cluster-namespace
Import already existing cluster
- monitor cluster and add-ons to be in ready state
- detach imported cluster
- monitor deletion of cluster-namespace
Check if local-cluster is imported and in ready state

Running E2E

clone this repo:

$ git clone git@github.com:stolostron/cluster-lifecycle-e2e.git

copy pkg/resources/options_template.yaml to pkg/resources/options.yaml, and update values specific to your environment:

$ cp pkg/resources/options_template.yaml pkg/resources/options.yaml

run testing:

From the project root:

$ export KUBECONFIG=~/.kube/config
$ ginkgo -v -p -stream pkg/tests/<test_package_name> -- -options=../../resources/options.yaml -v=3

for example:

ginkgo -v -p -stream pkg/tests/metrics -- -options=../../resources/options.yaml -v=3

You can run a specific test by adding the focus parameter, for example:

ginkgo -v -p -focus="import" -stream pkg/tests/import_cluster -- -options=../../resources/options.yaml -v=3

Running with Docker

clone this repo:

$ git clone git@github.com:stolostron/cluster-lifecycle-e2e.git
$ cd cluster-lifecycle-e2e

copy pkg/resources/options_template.yaml to resources/options.yaml, and update values specific to your environment:

$ cp pkg/resources/options_template.yaml resources/options.yaml

If you want run the "import" scenario, copy the kubeconfig of the cluster to import to pkg/tests/resources/hub/import/kubeconfig and set the kubeconfig of the cluster in the options.yaml to /opt/.kube/import-kubeconfig
oc login to your hub cluster where you want to run these tests - and make sure that remains the current-context in kubeconfig:

$ kubectl config current-context
open-cluster-management/api-demo-dev02-red-chesterfield-com:6443/kube:admin

Run make build-image. This will create a docker image:

$ make build-image

run the following command to get docker image ID, we will use this in the next step:

$ export docker_image_id=`docker images | grep cluster-lifecycle-e2e | sed -n '1p' | awk '{print $3}'`

run testing:

TEST_GROUP values can be

import -> to import an existing cluster
provision-all -> to provision aws, gcp, azure clusters in parallel
destroy -> to deatch an existing imported clusters and destroy provisioned cluster
metrics -> to test the clusterlifecycle metrics from prometheus
create-baremetal -> to provision baremetal cluster
destroy-baremetal -> to destroy baremetal cluster

For import test, save kubeconfig of cluster to be imported in path $(pwd)/pkg/tests/resources/hub/import/kubeconfig

$ docker run -v ~/.kube/config:/opt/.kube/config -v $(pwd)/pkg/tests/resources/hub/import/kubeconfig:/opt/.kube/import-kubeconfig -v $(pwd)/results:/results -v $(pwd)/pkg/resources:/resources -v $(pwd)/pkg/resources/options.yaml:/resources/options.yaml  --env TEST_GROUP="import" $docker_image_id

In Canary environment, this is the container that will be run - and all the volumes etc will passed on while starting the docker container using a helper script.

Contributing to E2E

Options.yaml

The values in the options.yaml are optional values read in by E2E. If you do not set an option, the test case that depends on the option should skip the test. The sample values in the option.yaml.template should provide enough context for you fill in with the appropriate values. Further, in the section below, each test should document their test with some detail.

Focus Labels