azure-functions-ml-infra

Terraform scripts to provision infrastructure for deployment to Azure functions, geared in particular towards deployment of machine learning models containerized with tools such as MLEM or BentoML.

Currently, no CICD is included (neither for the infrastructure, nor for the containers)

An Azure container registry is deployed and a linux azure functions app with pull rights to get containers from that registry. The app is also connected to a storage account in case it is needed.

There are two modules currently - one for the container registry and another one for the app and accompanying resources (a service plan, application insights and a storage account)

Quickstart

Infra

Set up an azure active directory and a subscription and use Azure CLI to authenticate.
Run
```
terraform init
```
to initialize the configuration
Change the variables in main.tf (alternatively also those in the modules). You might be required to change certain names which need to be globally unique. it is easiest to do with changing the prefix variables in variables.tf of each module.
terraform apply to create the infrastructure
Deploy a container to the ACR registry with docker.
Profit! (or terraform destroy the infrastructure)

Model Deployment

Note: The names of resources, models and containers etc. can vary based on how you change the terraform variables and how you name your models. This is just an illustrative example.

You should have a model (iris_classifier) at hand and use MLEM, BentoML or other tools to build it into a container with a FastAPI server (other serving options might also work, but I haven't tested it).
Login to your container registry (the name can vary based on how you change the terraform variables) az acr login --name mypreciouscontainers
Tag your local docker image with an alias with a full path to the registry, e.g.
```
docker tag iris_classifier mypreciouscontainers.azurecr.io/iris
```

push the image to the registry with

docker push mypreciouscontainers.azurecr.io/iris:latest

That's it, the service should be accessible at

https://myprecious-skynet-service-test.azurewebsites.net

TODO

Centralize variables in terraform.tfvars and add more configuration options to avoid having to rewrite the scripts themselves (at least as long as the usecase is not too far off)
Move storage account to a separate module (and make it optional?)
Add some example models and recipes for building them into containers
After that, also add examples of container deployment with CICD (currently has to be done manually)

Requirements

Name	Version
azurerm	~>3

Providers

No providers.

Modules

Name	Source	Version
app	./modules/app	n/a
container-registry	./modules/container-registry	n/a

Resources

No resources.

Inputs

No inputs.

Outputs

No outputs.

tibor-mach/azure-functions-ml-infra