/shared-azure-openai-tpm

This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage tokens per minute (TPM) for multiple tenants.

Primary LanguageC#MIT LicenseMIT

Stargazers