Pinned Repositories
DeepReduce
A Sparse-tensor Communication Framework for Distributed Deep Learning
DeepSpeedExamples
Example models using DeepSpeed
examples
A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
powersgd
Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
SLAMB
Large Batch Optimizer with Sparse Communication
grace
GRACE - GRAdient ComprEssion for distributed deep learning
grace-benchmarks
grace-data
hangxu0304's Repositories
hangxu0304/DeepReduce
A Sparse-tensor Communication Framework for Distributed Deep Learning
hangxu0304/SLAMB
Large Batch Optimizer with Sparse Communication
hangxu0304/examples
A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
hangxu0304/DeepSpeedExamples
Example models using DeepSpeed
hangxu0304/Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
hangxu0304/powersgd
Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727