ai-gateway

There are 21 repositories under ai-gateway topic.

  • Kong/kong

    🦍 The Cloud-Native API Gateway and AI Gateway.

    Language:Lua39.7k1k4.4k4.8k

  • BerriAI/litellm

    Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

    Language:Python15.5k863.9k1.8k
  • gateway

    Portkey-AI/gateway

    A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

    Language:TypeScript6.7k38394490

  • Calcium-Ion/new-api

    AI模型接口管理与分发系统，支持将多种大模型转为OpenAI格式调用、支持Midjourney Proxy、Suno、Rerank，兼容易支付协议，可供个人或者企业内部管理与分发渠道使用，本项目基于One API二次开发。🍥 The next-generation LLM gateway and AI asset management system supports multiple languages.

    Language:Go4.3k23477937

  • alibaba/higress

    🤖 AI Gateway | AI Native API Gateway

    Language:Go3.7k51689542

  • katanemo/archgw

    Arch is an intelligent gateway for agents. Engineered with (fast) LLMs for the secure handling, rich observability, and seamless integration of prompts with your APIs - outside business logic. Built by the core contributors of Envoy proxy, on Envoy.

    Language:Rust1.1k118449

  • APIParkLab/APIPark

    🦄APIPark is the #1 open-source AI Gateway and Developer Portal, enabling you to easily manage, integrate, and deploy AI and API services. APIPark seamlessly connects with various large AI models and packages these AI capabilities into APIs for easy invocation.

    Language:TypeScript7432054102

  • Kenza-AI/sagify

    LLMs and Machine Learning done easily

    Language:Python436185369

  • Portkey-AI/portkey-python-sdk

    Build reliable, secure, and production-ready AI apps easily.

    Language:Python54411017

  • adrianliechti/llama

    Inference Hub for AI at Scale

    Language:Go35315

  • Portkey-AI/portkey-node-sdk

    Build reliable, secure, and production-ready AI apps easily.

    Language:TypeScript293688
  • ai-gateway

    MagicAPI/ai-gateway

    Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.

    Language:Rust286

  • Portkey-AI/docs

    9498

  • huhuhang/bob-plugin-cloudflare

    Azure OpenAI + Cloudflare AI Gateway 进行翻译或润色

    Language:JavaScript6110

  • murataltanbas/openai-assistant-web-app-cloudflare

    ai assistant web app using openai assistant api + cloudflare services

    Language:JavaScript5101

  • cloud-apim/otoroshi-llm-extension

    Set of Otoroshi plugins to interact with LLMs

    Language:Scala32300

  • Portkey-AI/helm-chart

    Kubernetes Configs for Portkey Gateway deployment

    Language:Smarty3012
  • llm-api-gateway

    adumrewal/llm-api-gateway

    Gateway to control LLM API/SDK calls. Supports access to OpenAI, Azure, Anthropic and Bedrock calls

    Language:Python10

  • Portkey-AI/openapi

    OpenAPI specification for the Portkey API

    1100

  • lukemurraynz/AI_Gateway_Tests

    Tests and Bicep related to API Management AI Gateway testing.

    Language:Bicep10

  • MagicAPI/ai-gateway-ts

    Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.

    Language:TypeScript