/llama-cpp-python

llama-cpp-python forked version while contains some modifications, provides much more simpler inference API and demo. Integrated with my ChatBots.

Primary LanguagePythonMIT LicenseMIT

Watchers