huggingface/llm-vscode

Custom endpoint server

LucienShui opened this issue · 2 comments

Hi, I wrote a program that serving the model as the backend of this vscode plugin.
Model generation not working yet due to something about configuration I guess, but api's format is correct and tested.
I'll make it working soon.

LucienShui/huggingface-vscode-endpoint-server

Amazing 🔥 . Please let me know if you have any questions

Amazing 🔥 . Please let me know if you have any questions

Sorry for not responding earlier. I post this here just for sharing what I have done, this is more of a discussion rather than an issue.