llm-observability

There are 8 repositories under llm-observability topic.

  • langfuse

    langfuse/langfuse

    🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

    Language:TypeScript6.5k23693619

  • Helicone/helicone

    🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. 🍓 YC W23

    Language:TypeScript1.9k9149211

  • lmnr-ai/lmnr

    Laminar - open-source all-in-one platform for engineering AI products. Traces, Evals, Datasets, Labels. YC S24.

    Language:TypeScript1.1k31654

  • palico-ai/palico-ai

    Build, Evaluate, and Deploy your LLM Application with Flexibility and Typescript

    Language:TypeScript31239524

  • radicalbit/radicalbit-ai-monitoring

    A comprehensive solution for monitoring your AI models in production

    Language:Python70606

  • myscale/myscale-telemetry

    Open-source observability for your LLM application.

    Language:Python43532

  • AndrMoura/streamlit-chatbot-analytics

    Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring

    Language:Python6100

  • modelmetry/modelmetry-sdk-js

    The Modelmetry JS/TS SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

    Language:TypeScript1100