kstavro's Stars
guidance-ai/guidance
A guidance language for controlling large language models.
huggingface/candle
Minimalist ML framework for Rust
microsoft/aici
AICI: Prompts as (Wasm) Programs
coreylowman/dfdx
Deep learning in Rust, with shape checked tensors and neural networks
webonnx/wonnx
A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
oxigraph/oxigraph
SPARQL graph database
santiagomed/orca
LLM Orchestrator built in Rust
EricLBuehler/candle-vllm
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
EricLBuehler/candle-lora
Low rank adaptation (LoRA) for Candle.
clamchowder/MicrobenchmarksGui
An attempt to make a more accessible microbenchmark
coreylowman/llama-dfdx
LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
kstavro/identical-sentence-counter
A package whose purpose is to show case some of Python's best practices. Counts identical and nearly identical sentences to a queried one from a document.