66RING

Ultimate Super Badass. XDU | MSRA NRG | USTC. MLsys, Arch, Storage, blade learner and the CHAOTIC.

Chaotic Futurism; @SJTU-IPADS

Pinned Repositories

.config
my .config file
Language:Shell4 2 03
.vim
my vim config file
Language:Vim Script30
66RING.github.io
https://66ring.github.io/
Language:HTML2 2 01
bookmarks-nvim
Interactive mark and jump action in neovim.
Language:Lua90
dotfiles
My dotfiles
Language:Shell17 3 05
learn-vgpu-the-hard-way
qemu, cuda, virtio and kernel driver etc, none of which I understand, I just in awe.
Language:C71
ring-attention-pytorch
tiny ring attention implement for learning purpose
Language:Python4 3 11
scripts
some scripts
Language:Shell3 2 11
single-gpu-passthrough
Language:Shell2 1 01
tiny-flash-attention
flash attention tutorial written in python, triton, cuda, cutlass
Language:Cuda65 3 26

66RING's Repositories

66RING/tiny-flash-attention
flash attention tutorial written in python, triton, cuda, cutlass
Language:Cuda65 3 26
66RING/dotfiles
My dotfiles
Language:Shell17 3 05
66RING/ring-attention-pytorch
tiny ring attention implement for learning purpose
Language:Python4 3 11
66RING/scripts
some scripts
Language:Shell3 2 11
66RING/66RING.github.io
https://66ring.github.io/
Language:HTML2 2 01
66RING/Notes
my note things
2 2 01
66RING/single-gpu-passthrough
Language:Shell2 1 01
66RING/Counting-Stars-Local
Counting-Stars scripts for evaluating local llm.
Language:Python1
66RING/pytorch-cuda-binding-tutorial
Tutorial for building a custom CUDA and C function for torch
Language:Python11
66RING/the-chaos
Language:Rust1 1 0
66RING/15445-bootcamp
A basic introduction to coding in modern C++.
Language:C++0 0
66RING/66RING
2 0
66RING/academicpages.github.io
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
Language:JavaScript0 0
66RING/bufferline.nvim
A snazzy bufferline for Neovim
Language:Lua1 0
66RING/clash-verge
A Clash GUI based on tauri. Supports Windows, macOS and Linux.
Language:TypeScript1 0
66RING/data-structure
some implement of data structure
Language:Rust1 0
66RING/flash-attention
Fast and memory-efficient exact attention
Language:Python
66RING/LightSeq
Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
Language:Python
66RING/llama-playground
play with llama
Language:Python
66RING/LLMTest_NeedleInAHaystack-Local
run Needle In A Haystack with local LLM. check the makefile
Language:Jupyter Notebook
66RING/LongShortTokenDecoding
Long short token decoding speed up 4x for long context LLM. A hundreds of core code. Open source for learning.
Language:Python
66RING/minitorch
The full minitorch student suite.
Language:Python0 0
66RING/paperDB
2 0
66RING/PoSE
Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length
Language:Python1 0
66RING/RULER
This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
66RING/st
my st
Language:C2 0
66RING/system-fucking-rock
Language:Rust1 0
66RING/ThunderKittens
Tile primitives for speedy kernels
66RING/wallpapers
2 0
66RING/zephyr-nvim
Customized nvimdev/zephyr-nvim
Language:Lua0 0