/ai-gateway

Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.

Primary LanguageGoApache License 2.0Apache-2.0

Envoy AI Gateway

Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.

Contact

Get Involved

We adhere to the CNCF Code of conduct

The Envoy AI Gateway team meets every Thursday. Please register for the meeting, add agenda points, and get involved.

Background

The proposal of using Envoy Gateway as a Cloud Native LLM Gateway inspired the initiation of this project.