Pinned Repositories
attn-attn
CS194 Project: Attention + Transfer Learning + Domain Adaption
conex
Container Express is a tool to accelerate Docker push and pull.
corvette
Prediction Serving on Ray
event_metrics
An embedded, event-time metric collection library built for serving system
fijit-sys
Fijit Runtime Prototype
inferline-models
ray-serve-feast
Demo of running Ray Serve with Feast Feature Store on K8s
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
simon-mo's Repositories
simon-mo/conex
Container Express is a tool to accelerate Docker push and pull.
simon-mo/ray
A high-performance distributed execution engine
simon-mo/blog
simon-mo/rust-cupti
simon-mo/sp24
simon-mo/trireme
Websocket based training/inference server
simon-mo/vllm-community-dashboard
simon-mo/azure-sdk-for-rust
This repository is for active development of the *unofficial* Azure SDK for Rust. This repository is *not* supported by the Azure SDK team.
simon-mo/Azurite
A lightweight server clone of Azure Storage that simulates most of the commands supported by it with minimal dependencies
simon-mo/better-gh-inbox
simon-mo/FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
simon-mo/flashinfer
FlashInfer: Kernel Library for LLM Serving
simon-mo/jegonzal.github.com
Website
simon-mo/megablocks
simon-mo/model-loader
simon-mo/nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
simon-mo/pdf2htmlex-server
simon-mo/rust-extensions
Rust crates to extend containerd
simon-mo/s3s
S3 Service Adapter
simon-mo/simon-mo
simon-mo/sky-container
simon-mo/sky-packer
simon-mo/sky-snapshotter
simon-mo/sky-uploader
simon-mo/skyplane
🔥 Blazing fast bulk data transfers between any cloud 🔥
simon-mo/tar-rs
Tar file reading/writing for Rust
simon-mo/torchmuxer
simon-mo/uji
universal json ingester
simon-mo/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
simon-mo/webtorrent-cli
WebTorrent, the streaming torrent client. For the command line.