Cybertron AI

Organizing open-source AI

Pinned Repositories

autograd-hacks
Language:Python153 7 1332
autograd-lib
Language:Python33 4 77
bflm
Language:Python16 4 27
gradient-checkpointing
Make huge neural nets fit in memory
Language:Python2.7k 82 42271
imagenet18
Train ImageNet in 18 minutes on AWS
Language:Python126 5 719
imagenet18_old
Code to reproduce "imagenet in 18 minutes" DAWN-benchmark entry
Language:Python847 51 24162
ncluster
Lightweight interface to AWS
Language:Python47 4 885
pytorch-lamb
Implementation of https://arxiv.org/abs/1904.00962
Language:Python369 8 1049
pytorch-sso
PyTorch-SSO: Scalable Second-Order methods in PyTorch
Language:Python142 5 520
transformer-xl
Training Transformer-XL on 128 GPUs
Language:Python140 4 2113

cybertronai/gradient-checkpointing
Make huge neural nets fit in memory
Language:Python2.7k 82 42271
cybertronai/imagenet18_old
Code to reproduce "imagenet in 18 minutes" DAWN-benchmark entry
Language:Python847 51 24162
cybertronai/pytorch-lamb
Implementation of https://arxiv.org/abs/1904.00962
Language:Python369 8 1049
cybertronai/autograd-hacks
Language:Python153 7 1332
cybertronai/pytorch-sso
PyTorch-SSO: Scalable Second-Order methods in PyTorch
Language:Python142 5 520
cybertronai/transformer-xl
Training Transformer-XL on 128 GPUs
Language:Python140 4 2113
cybertronai/imagenet18
Train ImageNet in 18 minutes on AWS
Language:Python126 5 719
cybertronai/ncluster
Lightweight interface to AWS
Language:Python47 4 885
cybertronai/autograd-lib
Language:Python33 4 77
cybertronai/bflm
Language:Python16 4 27
cybertronai/Megatron-LM
Ongoing research training transformer language models at scale, including: BERT
Language:Python15 3 04
cybertronai/pytorch-fd
Implementation of fluctuation dissipation relations for automatic learning rate annealing.
Language:Python8 6 1
cybertronai/aws-network-benchmarks
Tools to benchmark AWS network performance
Language:Jupyter Notebook6 5 02
cybertronai/pytorch-aws
Example code for "PyTorch on AWS made easy"
Language:Python5 1 0