LzhinFdu

Pinned Repositories

InfiniTransformer
Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
Language:Python350 7 2531
EasyContext
Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
Language:Python694 8 4648
LWM
Large World Model -- Modeling Text and Video with Millions Context
Language:Python7.2k 66 72554
ring-attention-pytorch
Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
Language:Python497 11 1630
textflint
Text Robustness Evaluation Platform
Language:Python0 0 00
FastCkpt
Python package for rematerialization-aware gradient checkpointing
Language:Python24 2 24
LightSeq
Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
Language:Python204 5 109
ring-flash-attention
Ring attention implementation with flash attention
Language:Python656 13 3957

LzhinFdu/textflint
Text Robustness Evaluation Platform
Language:Python0 0 00