/LLM-Inference-API-in-Rust

LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.

Primary LanguageRustMIT LicenseMIT

LLM-Inference-API-in-Rust

LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.