/oci-storage-initializer

Demo for OCI protocol custom storage initializer https://kserve.github.io/website/latest/modelserving/storage/storagecontainers/

Primary LanguagePythonApache License 2.0Apache-2.0

OCI KServe Custom Storage Initializer

This repository provides an example of KServer custom storage initializer that showcases how users can automate a machine learning model deployment stored as OCI artifact using KServe.

NOTE: This repository was mainly intended for demoing purposes

The implementation was inspired by the default KServe storage container, this means that its integration should be pretty straightforward if required at some point.

Quickstart

Please take a look at Get Started guide for a very simple step-by-step example on how to use this OCI custom storage initializer to deploy an ML model stored as OCI artifact using KServe.

Development

Local development

Prerequisites:

  • Python
  • Poetry

NOTE: I would suggest to use a Python virtual environment as development environment

Install the dependencies:

make install-deps

Build the python wheel:

make build

Install the python package:

make install

Image build

Build the container image:

make image-build

Push the container image:

make image-push