Feature request: Python bindings for starcoder-cpp
crk-roblox opened this issue · 1 comments
crk-roblox commented
Similar to this repository for llama-cpp, is anyone aware of efforts to do the same for starcoder-cpp?
More broadly, I'm looking for the best (and easiest) way to get starcoder-cpp to run with Triton server.
Thanks in advance!
LanceaKing commented
Maybe you can try ctransformers for now?