simonkurtz-MSFT/python-openai-loadbalancer

Issues

• Bug Report: AttributeError when closing the httpx.AsyncClient

  #36 opened 2 months ago by giulio-utf
  4

• Add Support for Python 3.13

  #37 opened 2 months ago by simonkurtz-MSFT
  0

• Add Support for Multiple Models

  #35 opened 6 months ago by simonkurtz-MSFT
  0

• Support for authentication keys

  #32 opened 7 months ago by jjczopek
  1

• Add types throughout loadbalancer code

  #23 opened 7 months ago by simonkurtz-MSFT
  0

• Add Unit Tests

  #16 opened 7 months ago by simonkurtz-MSFT
  1

• Account for `retry-after-ms` header

  #14 opened 7 months ago by simonkurtz-MSFT
  0

• Add Support for OpenAI

  #17 opened 7 months ago by simonkurtz-MSFT
  0

• Investigate Streaming

  #4 opened 7 months ago by simonkurtz-MSFT
  0

• LoadBalancer does not yet support async

  #1 opened 7 months ago by simonkurtz-MSFT
  0

• Use lowest retryAfter when no backends are available

  #2 opened 8 months ago by simonkurtz-MSFT
  1

• Replace random with a truer uniform selection

  #3 opened 8 months ago by simonkurtz-MSFT
  1