Option to use alternatives to Openai

Question

Option to use alternatives to Openai

apcameron opened this issue a year ago · 6 comments

I am trying to use alternatives to openai
One alternative is to use https://github.com/go-skynet/LocalAI
Another is to use llama.cpp with the python API plugin which I have partially working. I just need to find a good model to use to generate code.

It would be nice to have official support for alternative locally housed alternatives

Answer 1 · 2023-06-08T18:43:37.000Z

try this one https://huggingface.co/replit/replit-code-v1-3b/tree/main

Answer 2 · 2023-06-08T21:03:16.000Z

I would like to see an option to choose other local models for noobs like me.

Answer 3 · 2023-06-11T02:30:54.000Z

Any progress on this yet? Or if someone has forked and implemented it that would be great too.

Answer 4 · 2023-06-22T03:58:13.000Z

@apcameron I wonder would StarCoder be a good model
https://huggingface.co/bigcode/starcoder#intended-use

Answer 5 · 2023-06-23T21:07:57.000Z

@shusso It may be but I do not have enough RAM to try that model on my local computers.