/nitro

A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API

Primary LanguageC++GNU Affero General Public License v3.0AGPL-3.0

Watchers