Pinned Repositories
Pai-Megatron-Patch
The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
expr
Expression language and expression evaluation for Go
expr
Expression language for Go
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
outlier_suppression
The official PyTorch implementation of the NeurIPS2022 paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models
Pai-Megatron-Patch
The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
QDrop
The official PyTorch implementation of the ICLR2022 paper, QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Megatron-LM
Ongoing research training transformer models at scale
torchrec
Pytorch domain library for recommendation systems
imh966's Repositories
imh966/Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
imh966/expr
Expression language for Go
imh966/outlier_suppression
The official PyTorch implementation of the NeurIPS2022 paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models
imh966/Pai-Megatron-Patch
The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
imh966/QDrop
The official PyTorch implementation of the ICLR2022 paper, QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization