openai-compatible

There are 31 repositories under openai-compatible topic.

  • shimmy

    ⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

    Language:Rust1.4k

  • mlx-openai-server

    A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

    Language:Python107

  • Z.ai2api

    将 Z.ai 代理为 OpenAI Compatible 格式，支持免令牌、智能处理思考链、图片上传等功能

    Language:Python51

  • falProxy

    A high-performance, self-hosted Deno proxy that makes Fal.ai's powerful models (Flux, SDXL, etc.) compatible with the standard OpenAI image generation API. Use any OpenAI client seamlessly.

    Language:TypeScript31

  • duckai

    duck.ai openai compatible api server

    Language:TypeScript29

  • agent-tars-glm-4.5-adapter

    让 GLM-4.5 完美适配 Agent TARS 系统的高性能适配器 - 解决 toolcall 兼容性，提供智能 fallback，极低成本享受顶级 AI Agent 体验

    Language:TypeScript19

  • ai-to-openai-hono

    An adapter to add OpenAI compatibility to your Hono app using the Vercel AI SDK

    Language:TypeScript10

  • kyutai-tts-openai-api

    A Docker-based OpenAI-compatible Text-to-Speech API server powered by Kyutai's TTS models with GPU acceleration support.

    Language:Python9

  • Spark-TTS-cli-api

    Spark-TTS Text-to-Speech with an OpenAI-compatible API, supporting seamless, unlimited-length generations. Includes a CLI interface.

    Language:Python9

  • UniAPI

    The Universal LLM Gateway - Integrate ANY AI Model with One Consistent API

    Language:C++8

  • copilot-to-api

    Complete guide to convert GitHub Copilot into an OpenAI-compatible API

    Language:JavaScript5

  • QuietPrompt

    Local-first Copilot-style assistant powered by screen, mic, and clipboard input — fully offline, works with any LLM or OCR engine. Press a key, get results. No cloud, no lock-in.

    Language:C#4

  • poe-api-bridge

    Poe API - OpenAI Compatible Wrapper

    Language:Python4

  • GodCore

    All-in-one local AI stack for Mistral-13B and Llama.cpp, with one-step CUDA wheel install, OpenAI-compatible API, and modern web dashboard. Switch between local and cloud chat, run on your own GPU, and deploy instantly—no API keys or paywalls. Designed for easy install, custom builds, and fast remote access. Enjoy!

    Language:Python4
  • BLOCKCHAIN-AGI-AIR

    BLOCKCHAIN-AGI-AIR

    🤖 Serverless AI on Hedera! Smart contracts run LLMs ⚙️ Distilled GGUF on IPFS. Pay crypto 🪙 → get replies 💬. 99.9% cheaper 💸 than big-tech APIs. Decentralized ⛓️ no censorship. “Gov can’t stop it. Nobody can.” 🧠 – Sir Charles Spikes , Cincinnati,Ohio| TELEGRAM: @SirGODSATANAGI✉️ SirCharlesspikes5@gmail.com #AGI #NoPC

    Language:Java3

  • synapse

    🧠 Synapse - Supercharge your AI coding assistants with memory, context, MCP tools, and intelligent routing. Works with Cline, Roo, Cursor, and any OpenAI-compatible tool. Just change the API endpoint and get superpowers! ✨

    Language:Python2

  • ComfyUI-OpenAI-Ask

    ComfyUI node: OpenAI-compatible Vision/QA with auto Prompt/Negative split

    Language:Python1

  • Lmss

    LmsSharp

    Language:C#1

  • minigen

    A light-weight framework for building AI agents with Native OpenAI API compatibility

    Language:Python1

  • claude-better-responses-mcp

    Improve Claude's coding responses with this MCP server

    Language:Python1

  • typhoon-ocr

    Windows-focused fork of Typhoon OCR. Gradio demo for PDF/image OCR to Markdown/HTML with layout & table extraction. Uses OpenAI-compatible API or vLLM via WSL2.

    Language:Python1

  • MCPConnectionHub

    MCP Connection Hub - A unified Model Context Protocol Gateway

    Language:Python1

  • Inferra-JS-SDK

    Official JavaScript/TypeScript SDK for Inferra API access

    Language:TypeScript1

  • Inferra-Python-SDK

    Official Python SDK for Inferra API access

    Language:Python1

  • LearnSynth

    Turn text/audio/video into study packs (summaries, concept maps, quizzes). Flutter + FastAPI. Uses GPT-OSS-20B (Replicate) by default, with optional fallbacks (OpenAI/Anthropic) and OSS modes (Ollama/vLLM).

    Language:Dart

  • coder

    Reverse engineering Claude Code for customization and multi-model integration

  • QuietPrompt

    QuietPrompt is a local-first AI tool for coding. Capture screen text, voice, or typed prompts and run them offline with your LLM; no cloud 🐙

    Language:C#

  • eduhaiku-agent

    A CLI AI Agent that replies to educational questions in Haiku format using Gemini API.

    Language:Python

  • vui-fastapi-server

    A OpenAI-compatible Text-to-Speech API server powered by VUI - a small conversational speech model

    Language:Python

  • pollinations

    Pollinations.AI integrations for Next.js/TypeScript: authentication (Referrer & Bearer), OpenAI-compatible text proxy, real-time SSE feeds for image & text, and MCP helpers—with production-ready docs,

    Language:TypeScript

  • BLOCKCHAIN-AGI-AIR

    🤖 Harness AI reasoning on blockchain with serverless architecture, utilizing HBAR tokens for on-demand, scalable intelligence without central servers.

    Language:Java