llm-ops
There are 24 repositories under llm-ops topic.
Kong/kong
🦍 The Cloud-Native Gateway for APIs & AI
bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
julep-ai/julep
Deploy serverless AI workflows at scale. Firebase for AI agents
Marker-Inc-Korea/AutoRAG
AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
truefoundry/cognita
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
EmbeddedLLM/JamAIBase
The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.
lastmile-ai/aiconfig
AIConfig is a config-based framework to build generative AI applications.
athina-ai/athina-evals
Python SDK for running evaluations on LLM generated responses
astronomer/ask-astro
An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
friendliai/friendli-client
[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI
demml/opsml
Quality Control for AI Artifact Management
YeonwooSung/MLOps
Miscellaneous codes and writings for MLOps
elotl/GenAI-infra-stack
Deployment of RAG + LLM model serving on multiple K8s cloud clusters
langgenius/dify-conversation
[🚧🚧🚧WIP🚧🚧 🚧]Rework of webapp-conversation
AndrMoura/streamlit-chatbot-analytics
Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring
prompt-foundry/typescript-sdk
The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.
GlyphyAI/liteswarm
Lightweight Agent Framework for building AI apps with any LLM
matdev83/llm-accounting
A Python package for tracking and analyzing LLM usage across different models and applications. It is primarily designed as a library for integration into development process of LLM-based agentic workflow tooling, providing robust tracking capabilities.
flavienbwk/repochat-action
Deploy an AI-powered chatbot for your repo in under 2 minutes.
tied-inc/eval-track
LLM-ML-Observability Toolkits and Serivces
matdev83/openrouter-inspector
A lightweight CLI for exploring OpenRouter AI models, listing provider endpoints with supported model parameters, and benchmarking endpoint latency and throughput.
willwoodward/woodwork-engine
An AI Agent IaC tool that aims to make developing and deploying AI Agents easier.
sumanth-dhanya/agentic-stocks-trading
LLM-Ops : An end to end production pipeline for agentic workflows