/aml-real-time-ai

Easily deploy models to FPGAs for ultra-low latency with Azure Machine Learning powered by Project Brainwave

Primary LanguageC#MIT LicenseMIT

Microsoft Azure Machine Learning Hardware Accelerated Models Powered by Project Brainwave

Easily create and train a model using various deep neural networks (DNNs) as a featurizer for deployment on Azure for ultra-low latency inferencing. These models are currently available:

  • ResNet 50
  • ResNet 152
  • DenseNet-121
  • VGG-16

How to get access

Azure ML Hardware Accelerated Models is currently in preview.

Step 1: Create an Azure ML workspace

Follow these instructions to install the Azure ML SDK on your local machine, create an Azure ML workspace, and set up your notebook environment, which is required for the next step.

Note: Only workspaces in the East US 2 region are currently supported.

Once you have set up your environment, install the contrib extras:

pip install --upgrade azureml-sdk[contrib]

Currently only tensorflow version<=1.10 is supported, so install it at the end:

pip install "tensorflow==1.10"

Go to the documentation page for any questions.

Step 2: Deploy your service

Check out the sample notebooks here.

Note: You can deploy one FPGA service. If you want to deploy more than one service, you must request quota by submitting the form. You will need information from your workspace created in Step 1 (learn how to get workspace information). You will receive an email if your quota request has been successful.

Support

Read the docs or visit the forum.

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.

When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

Build Status

System Unit tests
Ubuntu 16.04 Build Status