geniusrise/vision

Issues

• Abstract out inference and batch inference - vision

  #11 opened 6 months ago by ixaxaar
  0

• Add grpc and graphql endpoints

  #22 opened 8 months ago by ixaxaar
  0

• Add llama.cpp support for VQA

  #18 opened 8 months ago by ixaxaar
  0

• Integrate TorchDistributor based fine-tuning and inference on spark

  #17 opened 9 months ago by ixaxaar
  0

• Support OAUTH token introspection in APIs

  #16 opened 9 months ago by ixaxaar
  0

• Add K-V cache, more options for compilation

  #15 opened 9 months ago by ixaxaar
  0

• Implement streaming inference - vision

  #9 opened 9 months ago by ixaxaar
  0

• Implement batching for APIs - vision

  #10 opened 9 months ago by ixaxaar
  0

• Add lorax for vision as IMAGE (image generation) task

  #13 opened 9 months ago by ixaxaar
  0

• Add support for local models for llama.cpp in vision

  #14 opened 9 months ago by ixaxaar
  0

• Add IMAGE (image generation) task for vision

  #12 opened 9 months ago by ixaxaar
  0