A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API
Primary LanguageC++GNU Affero General Public License v3.0AGPL-3.0