gradsflow/fastserve-ai

Issues

• Add a messaging queue like Kafka or Amazon SQS for serving requests

  #25 opened 5 months ago by aniketmaurya
  2

• Integrate Ollama UI

  #19 opened 5 months ago by aniketmaurya
  2

• Add OpenAI API format for LLMs

  #3 opened 6 months ago by aniketmaurya
  4

• Add guardrail model

  #30 opened 7 months ago by aniketmaurya
  1

• do not process disconnected requests

  #20 opened 7 months ago by aniketmaurya
  1

• import path issue

  #43 opened 9 months ago by Ankush-Chander
  2

• Add HF models support

  #27 opened 10 months ago by antunsz
  2

• Create a Dockerfile template

  #24 opened 10 months ago by aniketmaurya
  3

• Enable pip package

  #17 opened 10 months ago by aniketmaurya
  1

• Any sample notebooks?

  #1 opened a year ago by andysingal
  2