cloud-apim/otoroshi-llm-extension

Issues

• add characters count fence

  #33 opened 2 months ago by mathieuancelin
  0

• add sentences count fence

  #34 opened 2 months ago by mathieuancelin
  0

• add text contains fence

  #35 opened 2 months ago by mathieuancelin
  0

• add word count fence

  #32 opened 2 months ago by mathieuancelin
  0

• implement a generic prompt fence mechanism

  #31 opened 2 months ago by mathieuancelin
  0

• add weight on loadbalancing

  #30 opened 2 months ago by mathieuancelin
  0

• Add more informations in events or emit custom events

  #12 opened 2 months ago by mathieuancelin
  0

• add option to include prompts and responses in analytics

  #18 opened 2 months ago by mathieuancelin
  0

• add universal mediation layer from/to OpenAI format

  #27 opened 2 months ago by mathieuancelin
  0

• support streaming on llm proxy

  #29 opened 2 months ago by mathieuancelin
  0

• support embedding on providers that supports it

  #28 opened 2 months ago by mathieuancelin
  0

• support stream apis on providers

  #15 opened 4 months ago by mathieuancelin
  0

• support additional content in prompt

  #26 opened 2 months ago by mathieuancelin
  0

• Support Cohere

  #3 opened 2 months ago by mathieuancelin
  0

• Support cloudflare

  #11 opened 2 months ago by mathieuancelin
  0

• Support Gemini

  #9 opened 2 months ago by mathieuancelin
  0

• Support Groq

  #10 opened 2 months ago by mathieuancelin
  0

• support HuggingFace

  #1 opened 2 months ago by mathieuancelin
  0

• support OVH AI Endpoints

  #19 opened 2 months ago by mathieuancelin
  0

• support actual embedding stores for semantic caches

  #17 opened 2 months ago by mathieuancelin
  0

• Custom model load balancing

  #6 opened 4 months ago by mathieuancelin
  0

• Support AWS Bedrock

  #8 opened 4 months ago by mathieuancelin
  0

• Custom provider load balancing

  #7 opened 4 months ago by mathieuancelin
  0

• Support provider fallback

  #5 opened 4 months ago by mathieuancelin
  0

• LLM Cache plugin

  #4 opened 4 months ago by mathieuancelin
  0

• support external validation of the input payload

  #14 opened 4 months ago by mathieuancelin
  0

• LLM Semantic cache plugin

  #16 opened 4 months ago by mathieuancelin
  0

• Support content validation before hitting the LLM

  #13 opened 4 months ago by mathieuancelin
  0

• Support Vertex AI

  #2 opened 4 months ago by mathieuancelin
  0