model-monitoring

evidentlyai/evidently

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

traceloop/openllmetry

Open-source observability for your LLM application, based on OpenTelemetry

deepchecks/deepchecks

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

NannyML/nannyml

nannyml: post-deployment data science in python

traceloop/openllmetry-js

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

MAIF/eurybia

⚓ Eurybia monitors model drift over time and securizes model deployment with data validation

squaredev-io/whitebox

[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes

traceloop/hub

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

aws-samples/amazon-sagemaker-mlops-workshop

MLOps workshop with Amazon SageMaker

evidentlyai/ml_observability_course

Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.

NimbleBoxAI/nbox

The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸

awesome-mlops/awesome-ml-monitoring

A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀

VectorInstitute/cyclops

A toolkit for evaluating and monitoring AI models in clinical settings

aporia-ai/inferencedb

🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)

rstudio/vetiver-python

Version, share, deploy, and monitor models.

Arize-ai/client_python

A python library to send data to Arize AI!

jomariya23156/full-stack-on-prem-cv-mlops

"1 config, 1 command from Jupyter Notebook to serve Millions of users", Full-stack On-Premises MLOps system for Computer Vision from Data versioning to Model monitoring and drift detection.

prabhuomkar/bitbeast

Experiments with Model Training, Deployment & Monitoring

JakobLS/mlops-credit-risk

MLOps for deploying a Credit Risk model

katonic-dev/explainit

A modern, enterprise-ready business intelligence web application

awesome-mlops/awesome-mlops-kubernetes

A curated list of awesome open source tools and commercial products that will help you train, deploy, monitor, version, scale, and secure your production machine learning on kubernetes 🚀

fiddler-labs/fiddler-examples

OLAMIDE100/Capstone-Project-Mlops-ZoomCamp

This is a capstone project associated with MLOps Zoomcamp. The end goal of the project is to build an end-to-end machine learning project containing feature engineering, training, validation, tracking, modeel deployment, hosting, and general engineering best practices aimed at making house price predictions.

evidentlyai/tracely

LLM application tracing based on OpenTelemetry

Ezzaldin97/Batch-Serving-ML-Pipeline

create a robust, simple, effecient, and modern end to end ML Batch Serving Pipeline Using set of modern open-source/free Platforms/Tools

basirati/model_monitoring

Model Monitoring using Prometheus and Grafana

cmigpereira/mlops-zoomcamp-project

Repo for my MLOps Zoomcamp project

Arize-ai/client_java

Java client to interact with Arize API

arthur-ai/arthur-sandbox

Example projects for Arthur Model Monitoring Platform

aditikhare007/Building-Production-Grade-LLMs

Aditi @ Building Production Grade LLMs - * Thank you AI community for visiting my repository - Stay tuned for awesome Dev-ops AI Learning Resources ** ** If you find the repository useful please give it a star - Thank you for visiting my repository - Happy Learning **

silverstone1903/reco-model-monitoring

fastapi + prometheus + grafana 💣

NewronAI/newron-sdk

Newron is a data-centric ML platform to easily build, manage, deploy and continuously improve models through data driven development.

aimlnerd/database-visualizer-tool

Demonstrate how to use graphana to easily create dashboard from data in postgres without redeveloping dashboard UI using angular/react etc. Example use case is machine learning model monitoring

demml/scouter

Production model monitoring and data profiling for machine learning workflows

pyladiesams/model-drift-beginner-dec2022

Learn how to handle model drift and perform test-based model monitoring