keldenl/gpt-llama.cpp

Add support for ai-code-translator

keldenl opened this issue · 2 comments

I've created a pull request that'll help get out-of-the-box support for gpt-llama.cpp in mckaywrigley/ai-code-translator#32

For now my fork (https://github.com/keldenl/ai-code-translator/tree/add-base-url) can be pulled instead to get this working for now

will write docs once the PR is in, but running OPENAI_API_HOST=http://localhost:443 npm run dev with my fork should do the job