/rust_llama_app

Chat bot (llama) written in rust using Yew and Tauri.

Primary LanguageRust

Rust llama app

Chat bot (llama) written in rust using Yew and Tauri.

"AI: Rust is good"

Usage

  1. Setup dev tools
rustup target add wasm32-unknown-unknown
cargo install trunk tauri
  1. Download a model from here
  2. Run the following to run dev mode.
cargo tauri dev
  1. Select the model you downloaded.

Roadmap

  • Setup pipeline
  • Setup issue template

Helpful Material

  1. Build A Full Stack Chatbot in Rust (feat. Leptos & Rustformers)
  2. Llm crate