Pinned Repositories
ColossalAI
Making large AI models cheaper, faster and more accessible
InternEvo
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
mamba
Mamba SSM architecture
alpa
Training and serving large-scale neural networks with auto parallelization.
apex
A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
ColossalAI
Making large AI models cheaper, faster and more accessible
myao
PyTorch native quantization and sparsity for training and inference
mytorchtitan
A native PyTorch Library for large model training
patchelf
A small utility to modify the dynamic linker and RPATH of ELF executables
varlen_mamba
zigzagcai's Repositories
zigzagcai/varlen_mamba
zigzagcai/InternEvo
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
zigzagcai/OpenRLHF
An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)
zigzagcai/TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
zigzagcai/verl
veRL: Volcano Engine Reinforcement Learning for LLM