/cortex.llamacpp

cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server at runtime.

Primary LanguageC++GNU Affero General Public License v3.0AGPL-3.0

Stargazers