anarchy-ai/LLM-VM

Issues

• Revamp Github issue form

  #442 opened 8 months ago by subhamkumarr
  1

• ModuleNotFoundError: No module named 'outlines.text'

  #440 opened a year ago by cerealceec
  3

• Create HTTP/HTTPS endpoints for inference and finetuning

  #359 opened a year ago by VictorOdede
  6

• Hosted inference + finetuning interface for AWS

  #356 opened a year ago by VictorOdede
  4

• Hosted inference + finetuning interface for Google Cloud

  #357 opened a year ago by VictorOdede
  1

• Mixed-model speculative sampling

  #367 opened a year ago by VictorOdede
  1

• Custom batch decoding algorithm

  #368 opened a year ago by VictorOdede
  3

• Load-balancing / auto-scaling for LLM serving on AWS

  #363 opened a year ago by VictorOdede
  3

• Load-balancing / auto-scaling for LLM serving on Google Cloud

  #375 opened a year ago by VictorOdede
  2

• Load-balancing / auto-scaling for LLM serving on Azure

  #376 opened a year ago by VictorOdede
  5

• Hosted inference + finetuning interface for Azure

  #377 opened a year ago by VictorOdede
  3

• LLM-VM does not support multiple GPUs currently

  #397 opened a year ago by MehmetMHY
  4

• macOS: Installation error

  #439 opened a year ago by cerealceec
  1

• Integrate FAISS in vector_db.py

  #393 opened a year ago by ajitalapati
  2

• Code refinements (unable to import errors)

  #364 opened a year ago by kshitiz305
  1

• Fix error handling and clean up client

  #431 opened a year ago by mmirman
  5

• parallel sampling with vLLM

  #370 opened a year ago by VictorOdede
  5

• cannot install llm-vm

  #427 opened a year ago by dshunter107
  4

• Downloading LLama2 and Other LLMs Running So Slow

  #437 opened a year ago by AfamO
  0

• HuggingFace Token

  #429 opened a year ago by AfamO
  2

• LLM-VM Does Not Run

  #436 opened a year ago by Z-ABBASI
  1

• README Llama2 Example Errors Requesting HuggingFace API Key

  #423 opened a year ago by collinarnett
  1

• Caching for repetitive requests on REST endpoints

  #362 opened a year ago by VictorOdede
  3

• Many Warnings when Running tests.

  #426 opened a year ago by collinarnett
  0

• Pyenv error in Debain 12

  #425 opened a year ago by anarchopossum
  2

• Queuing for concurrent requests on REST endpoints

  #360 opened a year ago by VictorOdede
  4

• Add new LLMs

  #418 opened a year ago by bilal-aamer
  2

• OSError: [E050] Can't find model 'en_core_web_md'.

  #421 opened a year ago by poju3185
  0

• integer type error

  #415 opened a year ago by saisri0102
  1

• Add support to change dtype for a model?

  #404 opened a year ago by MehmetMHY
  2

• Constrained generation error

  #414 opened a year ago by saisri0102
  0

• ability to load a `.pt` file into the student model

  #402 opened a year ago by daspartho
  0

• parallel sampling with TGI

  #369 opened a year ago by VictorOdede
  1

• llm-vm not running, though pip install method

  #405 opened a year ago by MehmetMHY
  2

• Refactor Openai API

  #398 opened a year ago by ajitalapati
  2

• AttributeError: module 'openai' has no attribute 'error'

  #390 opened a year ago by bpanahij
  6

• Integrate Weaviate Vector Store using WCS

  #394 opened a year ago by VictorOdede
  0

• working on Queuing_for_concurrent_requests_REST

  #391 opened a year ago by lucylililiwang
  1

• Unable to pip install

  #387 opened a year ago by suryachereddy
  1

• Create an Issue Template.

  #382 opened a year ago by shubhusion
  1

• Make meta-review and review guidelines

  #381 opened a year ago by mmirman
  1

• Kwargs don't work for "big_model" that isn't OpenAI based

  #353 opened a year ago by abhigya-sodani
  1

• Add gallery to anarchy.ai and README

  #380 opened a year ago by mmirman
  0

• setup on windows using bat

  #348 opened a year ago by yuqianlucy
  6

• Installation Steps in README failing for Windows

  #345 opened a year ago by Abdevna
  1

• BaseOnsiteLLM.generate() got an unexpected keyword argument 'temperature'

  #328 opened a year ago by daspartho
  1

• Streamlit Fails - signal only works in main thread of the main interpreter

  #340 opened a year ago by MehmetMHY
  4

• Duplicate file eval_finetuned.py , file throwing error while running

  #335 opened a year ago by kshitiz305
  0

• Fix Requirements

  #351 opened a year ago by abhigya-sodani
  2

• deep dive : pgvector

  #338 opened a year ago by laurenmoos
  0