A small standalone flask python server for llama.cpp that acts like a KoboldAI api.
Primary LanguagePython