/max-central-repo

Central Repository of Model Asset Exchange project. This repository contains information about the available models, current project status, contribution guidelines and supporting assets.

❗ We are Open Source and We Welcome Contributions ❗

Our mission at CODAIT is to democratize AI, to make AI technologies accessible to practitioners who understand real-world problems and enable them to develop AI solutions that solve these problems.

The core technologies behind today’s AI systems rely heavily on open-source software projects. Going from raw data to training data to models to solutions requires many open technologies, and it’s crucial that these technologies not only work well, but work well together. Our developers and data scientists are continually improving these frameworks with our targeted open source contributions, making them work better both individually and as an integrated pipeline. Hence our name — the Center for Open-Source Data and AI Technologies.

Subscribe to our newsletters to keep updated with the recent announcements here.

Model Asset Exchange

The Model Asset Exchange on IBM Developer is a place for developers to find and use free, open source, state-of-the-art deep learning models for common application domains. The curated list includes deployable models that you can run as a microservice locally or in the cloud on contanerization platforms like Docker, Kubernetes or OpenShift, and trainable models where you can use your own data to train the models.

Models are licensed under the Apache 2.0 License.

Domains covered: Text, Vision, Audio, and Time-Series.

Models can be consumed via:

  1. Any programming language
  2. WebApp
  3. Node-RED Flow
  4. Serverless App
  5. CodePen

Contact Us

If you have any questions that you would like to discuss with us:

  1. For general discussion, you are welcome to open an issue in our issue tracker.
  2. For a question about a particular model, you are welcome to open an issue in the corresponding repository. You can find a list of the repositories here.

Contributing to the Model Asset Exchange

We welcome anyone who wants to make contributions to the Model Asset Exchange. Please review the contribution guidelines. This project adheres to code of conduct mentioned here. By participating, you are expected to uphold this code.

  1. To start a general discussion create an issue in this repo.
  2. For model-specific questions, go to the corresponding model repository and create an issue.
  3. For those who want to contribute a model to MAX, here is a quick summary of the process:
    • To contribute code, documentation, or tests, please submit a pull request in the model's repository (a list is available).
    • Our maintainers will review your proposal.
    • If approved, wrap the model using the MAX-Skeleton as a guide.

We use Github Pull Requests for tracking requests and bugs, please direct any questions to our Slack channel.

Model Information

  1. Deployable Models
  2. Deployable and Trainable Models

Deployable Models

Domain Model Framework Dataset Application Model Consumption
Audio Audio Classifier Keras/TensorFlow Google AudioSet Classification

Demo
Node-RED
CodePen

Audio Audio Embedding Generator TensorFlow Google Audio Dataset Embeddings
Audio Audio Sample Generator TensorFlow Speech Commands and FMA Audio Modeling
Audio Speech to Text Converter TensorFlow Mozilla Common Voice Speech Recognition
NLP Text Summarizer TensorFlow CNN / Daily Mail Text Summarization
NLP Toxic Comment Classifier PyTorch Kaggle Toxic Comment Classification dataset Text Classification
NLP Chinese Phonetic Similarity Estimator Python Text Clustering/Phonetics
NLP News Text Generator TensorFlow One Billion Word Benchmark Dataset Language Modeling
NLP Review Text Generator Keras Kaggle Yelp Reviews Dataset Language Modeling
Vision Breast Cancer Mitosis Detector Keras TUPAC16 Image Classification
Vision Fast Neural Style Transfer PyTorch COCO 2014 Style Transfer
Vision Human Pose Estimator TensorFlow COCO Human Pose Estimation

Demo
WebApp
Node-RED
CodePen

Vision Image Caption Generator TensorFlow COCO Image Caption Generator

Demo
WebApp
Node-RED
CodePen

Vision Image Colorizer TensorFlow COCO Image Coloring
Vision Image Resolution Enhancer TensorFlow OpenImages v4 Super-Resolution
Vision Inception-ResNet-v2 Keras ImageNet Image Classification Node-RED
Vision Nucleus Segmenter Keras 2018 Data Science Bowl Object Detection
Vision Scene Classifier PyTorch Places365 Image Classification Node-RED
Vision Sports Video Classifier TensorFlow Sports-1M Video Classification
Time-Series Weather Forecaster TensorFlow/Keras JFK Airport Weather Data, NOAA Weather Prediction

Deployable and Trainable Models

Domain Model Framework Training Dataset for Deployable Model Application Model Consumption
NLP Text Sentiment Classifier TensorFlow IBM Claim Stance Dataset Sentiment Analysis
NLP Named Entity Tagger Keras Groningen Meaning Bank (GMB) Dataset Named Entity Recognition
NLP Question Answering TensorFlow SQuAD 1.1 Dataset Question and Answer
NLP Word Embedding Generator TensorFlow Random Text Word Embeddings
Vision Object Detector TensorFlow COCO Object Detection

WebApp
Node-RED
CodePen

Vision ResNet-50 Keras ImageNet Image Classification
Vision Image Segmenter TensorFlow VOC2012 ~10k images Semantic Image Segmentation

Demo
WebApp
Node-RED
CodePen

General resources

  1. Check the current status for the Model Asset Exchange ecosystem here.

  2. MAX Framework: Python package that contains common code shared across all MAX models - (link)

  3. MAX Skeleton: Docker based deployment skeleton for deep learning models on the Model Asset Exchange - (link)

  4. MAX Training Framework: WML training framework library for the Model Asset Exchange (link)

Tutorials

  1. Get started with the Model Asset Exchange
  2. Deploy deep learning models on Red Hat OpenShift
  3. Deploy MAX models to the cloud with Kubernetes
  4. Leverage deep learning in IBM Cloud Functions
  5. Leverage deep learning in your Node-RED flows
  6. Use Node-RED Node Generator to create new nodes from APIs and services

Blogs

  1. Get an introduction to the Model Asset Exchange on IBM Developer
  2. Open source and AI at IBM
  3. Expanding the reach of the IBM Model Asset eXchange
  4. An introduction to the internals of the Model Asset eXchange
  5. Where are my new models for NLP? They’re here!
  6. Running MAX Deep Learning models on Raspberry Pi

Slides and Video Recordings

Slides

  1. Slide - Ready to use Deep Learning Models: All You Need is 5 Minutes (Gabriela de Queiroz)

  2. Slide - Demystifying Data Science (Gabriela de Queiroz)

Videos

  1. Video - Image Cropping Web App (Nick Kasten) (based on the demp application code pattern)

    About : Use a free, open-source deep learning model to detect different types of objects in an image, then interact with them in a drag-and-drop web application.

  2. Video - Object Detector Web App demo (Alex Bozarth)

    About : The IBM Model Asset eXchange (MAX) has given application developers without data science experience easy access to prebuilt machine learning models. This web app uses the Object Detector from MAX and creates a simple web UI that displays bounding boxes around detected objects in an image and lets you filter the objects based on their label and probable accuracy given by the model.

  3. Video - Lighting Talk: IBM Code Model Asset Exchange (Brendan Dwyer)

    About: This talk walks you through the process of building Model Asset Exchange

  4. Video - Bringing an AI Ecosystem to the Domain Expert and Enterprise AI Developer (Frederick Reiss & Vijay Bommireddipalli)

    About : In this talk, we’ll break down the challenges a domain expert faces today in applying AI to real-world problems. We’ll talk about the challenges that a domain expert needs to overcome in order to go from “I know a model of this type exists” to “I can tell an application developer how to apply this model to my domain.”

  5. Video - Deploying Machine Learning Models in Practice (Nick Pentreath)

    About : The talk will cover various options for the most popular and widely used ML libraries, including MLeap, TF Serving and open standards such as PMML, PFA and the recently announced ONNX for Deep Learning. I will also introduce Aardpfark, initially covering Spark ML pipelines - as well as experimental work for exporting Spark ML pipelines to TensorFlow graphs for use with TF Serving.

  6. Video - Lessons Learned Building an Open Deep Learning Model Exchange (Nick Pentreath)

    About : This talk walks you through the process of building MAX and shares challenges and problems encountered, the solutions developed, and the lessons learned, along with best practices for cross-framework, standardized deep learning model training and deployment.

  7. Video - Deploy Deep Learning models as Microservices in minutes - Gabriela de Queiroz, Karthik Muthuraman and Saishruthi Swaminathan

    About The talk will cover Model Asset Exchange, Data Asset Exchange and explains steps for wrapping a custom model using MAX-Framework.

Community

  1. Join Community Slack
  2. CODAIT Twitter
  3. CODAIT Medium
  4. IBM Developer
  5. GitHub Issues