model-monitoring

evidentlyai/evidently

Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b

Giskard-AI/giskard

🐢 Open-Source Evaluation & Testing for LLMs and ML models

deepchecks/deepchecks

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

Arize-ai/phoenix

AI Observability & Evaluation

NannyML/nannyml

nannyml: post-deployment data science in python

traceloop/openllmetry

Open-source observability for your LLM application, based on OpenTelemetry

traceloop/openllmetry-js

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

MAIF/eurybia

⚓ Eurybia monitors model drift over time and securizes model deployment with data validation

squaredev-io/whitebox

[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes

NimbleBoxAI/nbox

The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸

aws-samples/amazon-sagemaker-mlops-workshop

MLOps workshop with Amazon SageMaker

aporia-ai/inferencedb

🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)

VectorInstitute/cyclops

Toolkit for evaluating and monitoring AI models in clinical settings

evidentlyai/ml_observability_course

Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.

rstudio/vetiver-python

Version, share, deploy, and monitor models.

awesome-mlops/awesome-ml-monitoring

A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀

Arize-ai/client_python

A python library to send data to Arize AI!

jomariya23156/full-stack-on-prem-cv-mlops

"1 config, 1 command from Jupyter Notebook to serve Millions of users", Full-stack On-Premises MLOps system for Computer Vision from Data versioning to Model monitoring and drift detection.

prabhuomkar/bitbeast

Experiments with Model Training, Deployment & Monitoring

katonic-dev/explainit

A modern, enterprise-ready business intelligence web application

JakobLS/mlops-credit-risk

MLOps for deploying a Credit Risk model

OLAMIDE100/Capstone-Project-Mlops-ZoomCamp

This is a capstone project associated with MLOps Zoomcamp. The end goal of the project is to build an end-to-end machine learning project containing feature engineering, training, validation, tracking, modeel deployment, hosting, and general engineering best practices aimed at making house price predictions.

basirati/model_monitoring

Model Monitoring using Prometheus and Grafana

fiddler-labs/fiddler-examples

Ezzaldin97/Batch-Serving-ML-Pipeline

create a robust, simple, effecient, and modern end to end ML Batch Serving Pipeline Using set of modern open-source/free Platforms/Tools

Arize-ai/client_java

Java client to interact with Arize API

awesome-mlops/awesome-mlops-kubernetes

A curated list of awesome open source tools and commercial products that will help you train, deploy, monitor, version, scale, and secure your production machine learning on kubernetes 🚀

cmigpereira/mlops-zoomcamp-project

Repo for my MLOps Zoomcamp project

aditikhare007/Building-Production-Grade-LLMs

Aditi @ Building Production Grade LLMs - * Thank you AI community for visiting my repository - Stay tuned for awesome Dev-ops AI Learning Resources ** ** If you find the repository useful please give it a star - Thank you for visiting my repository - Happy Learning **

arthur-ai/arthur-sandbox

Example projects for Arthur Model Monitoring Platform

NewronAI/newron-sdk

Newron is a data-centric ML platform to easily build, manage, deploy and continuously improve models through data driven development.

silverstone1903/reco-model-monitoring

fastapi + prometheus + grafana 💣

aimlnerd/database-visualizer-tool

Demonstrate how to use graphana to easily create dashboard from data in postgres without redeveloping dashboard UI using angular/react etc. Example use case is machine learning model monitoring

vathymut/dsos

Dataset shift with outlier scores

ashkan-mokarian/mlops-zoomcamp

Notes, homeworks, and projects for MLOps Zoomcamp @ datatalks.club