ai-observability

There are 26 repositories under ai-observability topic.

  • phoenix

    Arize-ai/phoenix

    AI Observability & Evaluation

    Language:Jupyter Notebook7k474.3k571

  • truera/trulens

    Evaluation and Tracking for LLM Experiments and AI Agents

    Language:Python2.8k17320220

  • lmnr-ai/lmnr

    Laminar - open-source all-in-one platform for engineering AI products. Create data flywheel for your AI app. Traces, Evals, Datasets, Labels. YC S24.

    Language:TypeScript2.3k13100136

  • openlit/openlit

    Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

    Language:Python1.9k18255184

  • fiddler-labs/fiddler-auditor

    Fiddler Auditor is a tool to evaluate language models.

    Language:Python18771820

  • radicalbit/radicalbit-ai-monitoring

    A comprehensive solution for monitoring your AI models in production

    Language:Python825011

  • Arize-ai/client_python

    A python library to send data to Arize AI!

    Language:Python57161417

  • bluewave-labs/flagwise

    Monitor, detect, and analyze security threats and Shadow AI in your LLM applications with comprehensive analytics and real-time alerting.

    Language:JavaScript30

  • fiddler-labs/fiddler-examples

    Language:Jupyter Notebook16403

  • Dynatrace/obslab-llm-observability

    Search for a holiday and get destination advice from an LLM. Observability by Dynatrace.

    Language:HTML1017140

  • fiddler-labs/fiddler-report-generator

    A report generator library for the ML models deployed on the Fiddler AI Observability platform

    Language:Python10201

  • Arize-ai/client_java

    Java client to interact with Arize API

    Language:Java71700

  • arthur-ai/arthur-sandbox

    Example projects for Arthur Model Monitoring Platform

    Language:Jupyter Notebook52213

  • okahu/okahu-demo

    This repo hosts a chatbot that runs in a docker container to demo Okahu AI Observability Cloud

    Language:Python5001

  • okahu/okahu-demo-openai

    This repo hosts a chatbot that runs in Github Codespaces to demo Okahu AI Observability Cloud with OpenAI

    Language:Python5101

  • openlit/.github

    3200

  • openlit/dokumetry-python

    Official Python Library to monitor your LLM Application with Doku

    Language:Python3200

  • Shard-AI/Shard

    Open Source Video Understanding API and Large Vision Model Observability Platform.

    Language:Python2000
  • OpenAI-Sora-SV

    alexis8112/OpenAI-Sora-SV

    1

  • ksm26/Evaluating-AI-Agents

    A hands-on course repository for Evaluating AI Agents, created with Arize AI, that teaches you how to systematically evaluate, debug, and improve AI agents using observability tools, structured experiments, and reliable metrics. Learn production-grade techniques to enhance agent performance during development and after deployment.

    Language:Jupyter Notebook1

  • modelmetry/modelmetry-sdk-js

    The Modelmetry JS/TS SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

    Language:TypeScript1100

  • modelmetry/modelmetry-sdk-python

    The Modelmetry Python SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

    Language:Python1101

  • openlit/dokumetry-node

    Official NodeJS library for monitoring LLM Applications with Doku

    Language:JavaScript1211

  • boda12020202ws/OpenAI-Sora-SV

    🎥 Create stunning, hyper-realistic videos from text with advanced editing and multi-modal understanding for unique storytelling experiences.

  • Shubham8831/LangSmith-Tutorial

    🔍 Complete LangSmith Tutorial: Master AI Observability & Debugging | Learn to trace, monitor, and evaluate LLM applications with hands-on examples from simple chains to complex RAG pipelines and Agents

    Language:Python

  • WeitLion/brokle

    📊 Observe and route LLM apps with Brokle, your open-source solution for production-grade AI observability and transparent infrastructure management.

    Language:TypeScript