bigcode-project/starcoder.cpp

Servermode for working as endpoint for VSCode Addon "HF Code Autocomplete"

VfBfoerst opened this issue · 2 comments

VfBfoerst commented

Hi,
is there already a feature to start this in something like a Server-Mode? I want to use starcoder as an endpoint for the VSCode-Addon HF Code Autocomplete and also later for a chat interface like huggingchat.

fwxfasp commented

hi,
don't want to open a separate issue for this:

I wonder if this project still is in active development
the last commit was 1 month ago, so I'm not sure if working with the cpp implementation makes any sense in general.
also the communication in the issues doesn't seem to be too active.
(no offense at all, I'm just curious 😄)

  • 👀1
matthoffner commented

Hi, I have a FastAPI setup to demo a ggml Starcoder using ctransformers (https://github.com/marella/ctransformers):

https://huggingface.co/spaces/matthoffner/starchat-ggml
UI chat demo: https://huggingface.co/spaces/matthoffner/starchat-ui

Not sure if it works with the HF VScode extension, will look into that!

  • 👍2