Using GPT-Llama as the api for SGPT returns a JSON error
idontneedonetho opened this issue · 1 comments
idontneedonetho commented
As the title says, while using GPT-Llama as the api for SGPT(https://github.com/TheR1D/shell_gpt), it returns a JSON error(https://pastebin.com/31jF8x5C)
To get to this point, I modified the "C:/User/[user]/.config/shell_gpt/.sgptrc" file to add "http://localhost:443" to the OPENAI_API_HOST, and the path to the model I wanted to use, in this case, vicuna 13b, to the OPENAI_API_KEY.
keldenl commented
pretty long pastebin but what specifically did you get returned in the gpt-llama.cpp terminal?