Image of Fiddler logo

This repo contains example notebooks and accompanying documentation for using Fiddler.

Examples

The goal of these example notebooks is to give you a quick start on various Fiddler capabilities using different model frameworks and data types. You can also use these as a reference guide to upload your dataset and model along with production traffic that you want to monitor or explain using Fiddler.

To get started

Use the projects in this repo to onboard models and data to illustrate model monitoring and explainability.
This repo contains the projects listed below. You can launch them in a Google Collab environment right from here:

The Basics

  1. Model Monitoring Quickstart with Sample Data Open In Colab
  2. LLM/GenAI Monitoring Quickstart with Sample Data Open In Colab
  3. Managing Model Versions with Fiddler Open In Colab
  4. XAI with Surrogate Models Open In Colab
  5. Adding Model Artifacts for XAI Open In Colab

Use Case Specific

  1. Image/Computer Vision Model Monitoring Open In Colab
  2. NLP Model Monitoring - Multiclass Classification Open In Colab
  3. Class Imbalance Drift Detection Open In Colab
  4. Ranking Model - Monitoring and Explainability Open In Colab

License

This project is licensed under the MIT license. See the LICENSE file for more info.

Want to learn more?

Additional useful links: