EricLBuehler's Stars
huggingface/pytorch-image-models
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
huggingface/tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
lamm-mit/PDF2Audio
nbQA-dev/nbQA
Run ruff, isort, pyupgrade, mypy, pylint, flake8, and more on Jupyter Notebooks
tracel-ai/cubecl
Multi-platform high-performance compute language extension for Rust.
haoliuhl/ringattention
Large Context Attention
cdisselkoen/llvm-ir
LLVM IR in natural Rust data structures
bosun-ai/swiftide
Fast, streaming indexing, query, and agent library for building LLM applications in Rust
microsoft/vattention
Dynamic Memory Management for Serving LLMs without PagedAttention
HanGuo97/flute
Fast Matrix Multiplications for Lookup Table-Quantized LLMs
Vaibhavs10/hf-llm.rs
raspberrypi/rp2350_hacking_challenge
Cornell-RelaxML/qtip
Dan-wanna-M/kbnf
A high-performance constrained decoding engine based on context free grammar in Rust
atoma-network/atoma-infer
Fast serverless LLM inference, in Rust.
yaman/fashion-clip-rs
A complete(grpc service and lib) Rust inference with multilingual embedding support. This version leverages the power of Rust for both GRPC services and as a standalone library, providing highly efficient text and image embeddings.
ShelbyJenkins/candle_embed
A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
MistApproach/callm
Run Generative AI models directly on your hardware
jakobwesthoff/pixel_loop
A Rust implementation for fixed time game/update loops
EricLBuehler/candle_graphs
Graph model execution API for Candle
EricLBuehler/zig_ml
Tensor library for Zig
EricLBuehler/candle-benching
Benchmarking for Candle
domWinter/rustyrag
This project implements a simple semantic search and RAG use-case with rust (mistral.rs/fastembed-rs) + pgvector and serves a frontend and rest-api for book recommendation.
ericcarmi/local-llm
local llm stuff
smpurkis/asm_rs_bench
gemv, gemm, llama.cpp arm64 optimised bench
EricLBuehler/uqff_maker
Automated generation of UQFF models with mistral.rs.
guoqingbao/Candle-GCU
Candle ML Computing Framework on Enflame GCU
Narsil/serde_pyo3
MistApproach/callm-demos
Examples and tools to help you get started with callm
vagmi/mistrs
An example to play with mistral.rs