llm-gateway
There are 32 repositories under llm-gateway topic.
Kong/kong
🦍 The Cloud-Native API Gateway and AI Gateway.
BerriAI/litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
coaidev/coai
🚀 Next Generation AI One-Stop Internationalization Solution. 🚀 下一代 AI 一站式 B/C 端解决方案，支持 OpenAI，Midjourney，Claude，讯飞星火，Stable Diffusion，DALL·E，ChatGLM，通义千问，腾讯混元，360 智脑，百川 AI，火山方舟，新必应，Gemini，Moonshot 等模型，支持对话分享，自定义预设，云端同步，模型市场，支持弹性计费和订阅计划模式，支持图片解析，支持联网搜索，支持模型缓存，丰富美观的后台管理与仪表盘数据统计。
katanemo/archgw
The smart edge and AI gateway for agents. Arch is a high-performance proxy server that handles the low-level work in building agents: like applying guardrails, routing prompts to the right agent, and unifying access to LLMs, etc. Natively designed to handle and process prompts, Arch helps you build agents faster.
APIParkLab/APIPark
Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs.🦄云原生、超高性能 AI&API网关，LLM API 管理、分发系统、开放平台，支持所有AI API，不限于OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 请求和返回，API申请与审批，调用统计、负载均衡、多模型灾备。一键部署，开箱即用。
langdb/ai-gateway
Govern, Secure, and Optimize your AI Traffic. AI Gateway provides unified interface to all LLMs using OpenAI API format with a focus on performance and reliability. Built in Rust.
maximhq/bifrost
The Fastest LLM Gateway with built in OTel observability and MCP gateway
LianjiaTech/bella-openapi
Bella OpenAPI是一个提供了丰富的AI调用能力的API网关，可类比openrouter，与之不同的是除了提供聊天补全(chat-completion)能力外，还提供了文本向量化(text-embedding)、语音识别(ASR)、语音合成(TTS)、文生图、图生图等多种AI能力，同时集成了计费、限流和资源管理功能。且集成的所有能力都经过了大规模生产环境的验证。
langfuse/oss-llmops-stack
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.
starbased-co/ccproxy
Customize and Extend Claude Code with ccproxy: Route to OpenAI, Gemini, Qwen, OpenRouter, and Ollama. Gain full control of your Claude Max/Pro Subscription with your own router.
bluewave-labs/LangRoute
This is a robust and configurable LLM proxy server built with Node.js, Express, and PostgreSQL. It acts as an intermediary between your applications and various Large Language Model (LLM) providers
fabiojbg/LLMApiGateway
A personal LLM gateway with fault-tolerant capabilities for calls to LLM models from any provider with OpenAI-compatible APIs. Advanced features like retry, model sequencing, and body parameter injection are also available. Especially useful to work with AI coders like Cline and RooCode and providers like OpenRouter.
teilomillet/hapax
The reliability layer between your code and LLM providers.
shengyanli1982/llmproxy
🧭🧭 An intelligent load balancer with smart scheduling that unifies diverse LLMs.
hypersigilhq/hypersigil
Prompt management gateway with a UI for AI-powered applications. Enables non-technical users to test, refine, and deploy prompts seamlessly across multiple AI providers.
cloud-apim/otoroshi-llm-extension
Connect, setup, secure and seamlessly manage LLM models using an Universal/OpenAI compatible API
ozanunal0/Prometheus-Gateway
An open-source, security-first LLM Gateway designed to provide a unified, secure, and observable entry point to any Large Language Model.
burgonet-eu/gateway
Burgonet Gateway is an enterprise LLM gateway that provides secure access and compliance controls for AI systems
knnlabs/Conduit
A unified API gateway for multiple LLM providers with OpenAI-compatible endpoints
Tanantor/langgate
Lightweight AI inference gateway - local model registry & parameter transformer (Python SDK) - with optional Envoy proxy processor and FastAPI registry server deployment options.
charmitro/ai-proxy
A lightweight proxy for LLM API calls with guardrails, metrics, and monitoring. A vibe coding experiment.
billebel/splunk-community-ai
A secure, governable AI gateway for Splunk with operational guardrails. An alternative to Splunk AI Assistant focused on safety, compliance, and predictable results using a 'Configuration as Code' approach."
claymore666/MCPConnectionHub
MCP Connection Hub - A unified Model Context Protocol Gateway
frontllm/frontllm-sdk
FrontLLM is your public gateway to LLMs. Request LLM directly from your front-end code. No backend needed.
jonthanliu/gemini-gateway
An intelligent AI gateway that provides a unified API for Google's Gemini models, featuring load balancing, failover, and a real-time management dashboard. Seamlessly integrate Gemini into any application with support for OpenAI or Anthropic APIs. 智能AI网关，为Google Gemini模型提供统一的API接口，支持负载均衡、故障转移和实时管理仪表盘。将Gemini集成到任何支持OpenAI或Anthropic API的客户端。
nazdridoy/llm-proxy
A robust, transparent REST API proxy service for LLM APIs with profile-based configuration and comprehensive logging.
riipandi/sorai
[WIP] Sorai is a lightweight, high-performance, and open-source LLM proxy gateway.
scampion/burgonet-gateway
Burgonet Gateway is an enterprise LLM gateway that provides secure access and compliance controls for AI systems
Floofies/llmcord
This repository contains my development branches for contributing to llmcord 2β
harshita-d/Conductor_LLM_Platform
Enterprise LLM Orchestration Platform - Intelligently route requests across multiple AI providers with cost optimisation and real-time monitoring
viniViado/LLMSecOps
LLMSecOps focuses on integrating security practices within the lifecycle of machine learning models. It ensures that models are robust against threats while maintaining compliance and performance standards.