ai-observability

lmnr-ai/lmnr

Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.

openlit/openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 40+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

fiddler-labs/fiddler-auditor

Fiddler Auditor is a tool to evaluate language models.

radicalbit/radicalbit-ai-monitoring

A comprehensive solution for monitoring your AI models in production

Arize-ai/client_python

A python library to send data to Arize AI!

fiddler-labs/fiddler-examples

fiddler-labs/fiddler-report-generator

A report generator library for the ML models deployed on the Fiddler AI Observability platform

Arize-ai/client_java

Java client to interact with Arize API

Dynatrace/obslab-llm-observability

Search for a holiday and get destination advice from an LLM. Observability by Dynatrace.

okahu/okahu-demo

This repo hosts a chatbot that runs in a docker container to demo Okahu AI Observability Cloud

okahu/okahu-demo-openai

This repo hosts a chatbot that runs in Github Codespaces to demo Okahu AI Observability Cloud with OpenAI

arthur-ai/arthur-sandbox

Example projects for Arthur Model Monitoring Platform

openlit/.github

modelmetry/modelmetry-sdk-js

The Modelmetry JS/TS SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

modelmetry/modelmetry-sdk-python

The Modelmetry Python SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

openlit/dokumetry-node

Official NodeJS library for monitoring LLM Applications with Doku

openlit/dokumetry-python

Official Python Library to monitor your LLM Application with Doku