timoklimmer/powerproxy-aoai
Monitors and processes traffic to and from Azure OpenAI endpoints.
PythonMIT
Issues
- 6
- 9
- 0
Add support for CORS
#100 opened by timoklimmer - 1
- 1
- 2
Whisper support
#97 opened by krohm - 4
- 2
- 5
Experiencing ResponseNotRead errors
#89 opened by LeonKalt - 3
Experiencing PoolTimeouts
#90 opened by LeonKalt - 7
- 4
- 1
Feature: load-balance between instances
#88 opened by jjczopek - 3
Routing issue when sending both api-key and authorization in header in v0.10.0
#79 opened by LeonKalt - 18
- 2
adding token limits per client per model
#71 opened by krahnikblis - 3
Error message when calling deployed powerproxy
#76 opened by sterankin - 4
feature idea: client stream request -> proxy switch to batch -> AOAI -> proxy switch to stream response -> client
#73 opened by krahnikblis - 1
Error running locally
#70 opened by sterankin - 2
Using stream causing a code: "ECONNRESET"
#65 opened by krohm - 1
- 0
[Bug] Streaming proxy response breaks clients by `Content-Length` and `Transfer-Encoding: chunked` headers together
#53 opened by sergey124 - 5