bigcode-project/starcoder.cpp

Issues

• convert-hf-to-ggml.py CUDA out of memory

  #35 opened 9 months ago by Alex20129
  0

• No useful output

  #33 opened a year ago by DavidARivkin
  1

• python3 convert-hf-to-ggml.py bigcode/starcoderplus is failing with error: RuntimeError: PytorchStreamReader failed reading zip archive: failed finding central directory

  #29 opened a year ago by antonakv
  1

• Inference with GPU?

  #30 opened a year ago by cdj0311
  1

• Feature request: Python bindings for starcoder-cpp

  #23 opened a year ago by crk-roblox
  1

• Prevent starchat from generating nonsense after ouptutting <|system|> <|end|> <|user|>

  #32 opened a year ago by KukumavMozolo
  0

• Add `bigcode/starcoderbase-1b` and `bigcode/starcoderbase-7b` to README

  #31 opened a year ago by NouamaneTazi
  0

• starchat-beta support

  #20 opened a year ago by ftufkc
  2

• python requirements.txt is missing

  #28 opened a year ago by antonakv
  1

• make failed on Ubuntu18.04

  #27 opened a year ago by colongj
  1

• LSP?

  #9 opened 2 years ago by s7726
  1

• Mac M1 metal support

  #26 opened a year ago by slavag
  0

• SantaCoder works but never seems to generate <|end|>

  #25 opened a year ago by the-crypt-keeper
  1

• Servermode for working as endpoint for VSCode Addon "HF Code Autocomplete"

  #22 opened a year ago by VfBfoerst
  2

• Unable to build on Windows

  #17 opened a year ago by idontcare999a
  2

• Interactive chat and gpu offload support

  #19 opened a year ago by RahulVivekNair
  0

• Models fail to load

  #21 opened a year ago by peter-ciccolo
  0

• Starcoder conversion and quantization instructions

  #5 opened a year ago by aseok
  4

• Inference with Starcoder model finetuned by lora

  #18 opened a year ago by edwardelric1202
  1

• can't run the starcoder-ggml.bin

  #16 opened a year ago by breakenknife
  2

• Attempts at converting fine-tuned models fail without explanation

  #15 opened a year ago by umm-maybe
  1

• Can i run starcoder.cpp locally on Windows11? Will 16gb ram be enough for it?

  #8 opened a year ago by JohnClaw
  1

• Why quantized by starcoder.cpp and by ggml example models are different?

  #11 opened a year ago by s-kostyaev
  5

• How much memory is required ?

  #13 opened a year ago by breakenknife
  1

• trying to ggml the starpii but seeing following error, anything i need to further check?

  #12 opened a year ago by wesleysanjose
  1

• Doesn't seem to work for me.

  #14 opened a year ago by fpena06
  2

• Licence missing

  #10 opened a year ago by michaelfeil
  0

• context memory pool

  #3 opened 2 years ago by Leterax
  1

• feature request: interactive mode

  #4 opened 2 years ago by jorditg
  1