do-katib: a simple Docker wrapped project to run Katib Experiments in Kubeflow.

This Repo contains a simple starter project which wraps a model method and parses arguments according to Katib's format.

How To Use This Project:

An indepth exploration of the project is provided in this Blog Post: End-to-End Hyperparameter Tuning with Katib, Tensorflow, Keras and Nvidia GPU on a gaming laptop

The user familiar with ML and Containers base concepts can use the sample method to implement their own models and Experiment on an existing Kubeflow deployment.

Katib Templates:

Some sample Katib YAML files can be found in the katib folder.

To run the base experiments on this project, one can simple run the following command on an existing kubernetes cluster with kubeflow deployment:

kubectl apply -f https://raw.githubusercontent.com/fabiononato/do-katib/master/katib/random-experiment.yaml

Building the project:

This project is set as a Depend-on-Docker automation that will help you build a container around the Katib wrapped method.

The main entrypoint to the project is the script containing the my_model method. Once you've added a call to your model into this script, you'll need to build the project image. Please refer to the Depend-on-Docker project documentation for more details.

The modifications specific to this projects are:

a test scrip that checks for the proper set up of the NVIDIA drivers, as this project rely on a GPU version of TF.
an environment file with a registry and project name specific to this project.
a tensorflow-gpu base image on our Dockerfile.