/moonweb

This project is a web-based LLM (Large Language Model) chat tool developed using Rust, the Dioxus framework, and the Candle framework. It supports multiple open-source LLM models and features dynamic model loading architecture. Each LLM operates as an independent process and communicates via ZeroMQ.

Primary LanguageRustMIT LicenseMIT

No issues in this repository yet.