shyhuai

Assistant Professor

Harbin Inistitute of Technology, ShenzhenShenzhen, China

Pinned Repositories

caffe-optimized
Language:C++0 2 00
dlbench
Benchmarking State-of-the-Art Deep Learning Software Tools
Language:Python170 15 2647
adahessian
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
Language:Python0 0 00
attention-is-all-you-need-pytorch
A PyTorch implementation of the Transformer model in "Attention is All You Need".
Language:Python00
B-Caffe
MG-WFBP: Efficient Data Communication for Distributed Synchronous SGD Algorithms
Language:C++4 1 12
eva
[ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
Language:Python1 0 00
gtopkssgd
gTop-k S-SGD: A Communication-Efficient Distributed Synchronous SGD Algorithm for Deep Learning
Language:Python1 0 00
kfac_pytorch
Distributed K-FAC Preconditioner for PyTorch
Language:Python1 0 01
webrtc-ios
webrtc build on ios
Language:Objective-C1 2 00

shyhuai's Repositories

shyhuai/B-Caffe
MG-WFBP: Efficient Data Communication for Distributed Synchronous SGD Algorithms
Language:C++4 1 12
shyhuai/eva
[ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
Language:Python1 0 00
shyhuai/gtopkssgd
gTop-k S-SGD: A Communication-Efficient Distributed Synchronous SGD Algorithm for Deep Learning
Language:Python1 0 00
shyhuai/kfac_pytorch
Distributed K-FAC Preconditioner for PyTorch
Language:Python1 0 01
shyhuai/adahessian
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
Language:Python0 0 00
shyhuai/attention-is-all-you-need-pytorch
A PyTorch implementation of the Transformer model in "Attention is All You Need".
Language:Python00
shyhuai/byteps
A high performance and generic framework for distributed DNN training
Language:Python0 0 00
shyhuai/caffe
Caffe: a fast open framework for deep learning.
Language:C++1 0
shyhuai/DataProvider.torch
Data providers for Torch
Language:Lua
shyhuai/ddl-benchmarks-1
ddl-benchmarks: Benchmarks for Distributed Deep Learning
Language:Python0 0
shyhuai/DeepSpeechRecognition
A Chinese Deep Speech Recognition System 包括基于深度学习的声学模型和基于深度学习的语言模型
Language:Python0 0
shyhuai/DistNeRF
A PyTorch implementation of NeRF (Neural Radiance Fields) that reproduces the results.
Language:Python0 0
shyhuai/dl_scheduling
Language:Python0 0
shyhuai/FADNet
Language:Python0 0
shyhuai/fiddler
Fast Inference of MoE Models with CPU-GPU Orchestration
shyhuai/GaussianK-SGD
Understanding Top-k Sparsification in Distributed Deep Learning
Language:Python0 01
shyhuai/gblastn
G-BLASTN is a GPU-accelerated nucleotide alignment tool based on the widely used NCBI-BLAST.
Language:C++0 0
shyhuai/horovod
Distributed training framework for TensorFlow, Keras, and PyTorch.
Language:C++1 01
shyhuai/mpi4py
Python bindings for MPI that supports ULFM
Language:Python1 0
shyhuai/nccl
Optimized primitives for collective multi-GPU communication
Language:Cuda1 0
shyhuai/openai-gemm
Open single and half precision gemm implementations
Language:C1 0
shyhuai/Optimus-CC
[ASPLOS'23] Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression
Language:Python0 0
shyhuai/pipedream
Language:Python0 0
shyhuai/PySyft
A library for encrypted, privacy preserving deep learning - based on PyTorch
Language:Python1 0
shyhuai/pytorch-sso
PyTorch-SSO: Scalable Second-Order methods in PyTorch
Language:Python0 0
shyhuai/tensorflow
Computation using data flow graphs for scalable machine learning
Language:C++1 0
shyhuai/thundersvm
ThunderSVM: A Fast SVM Library on GPUs and CPUs
Language:C++1 0
shyhuai/training
Reference implementations of MLPerf™ training benchmarks
Language:Python0 0
shyhuai/tutel
Tutel MoE: An Optimized Mixture-of-Experts Implementation
Language:Python0 0
shyhuai/XLearning
AI on Hadoop
Language:Java1 0