caraml-dev/merlin

Add E2E test that run Python SDK test

Opened this issue · 0 comments

The Python SDK contains the test files that interact with the running Merlin server and its model cluster. Having it running in GitHub Actions will enable the developers to be more confident in introducing their changes.

The current E2E itself only deploys the Merlin server to the KinD cluster but there's no testing for model management, deployment, and serving.

These components need to be installed in E2E KinD cluster:

  • Istio
  • Knative
  • KFServing
  • Vault
  • Spark Operator
  • Minio (For GCS replacement -- for MLFlow storage backend)

We also need to add a pytest-dependency library and update the decorator to make sure the test ordered correctly.