HeyangQin

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

DeepSpeedExamples

Example models using DeepSpeed

FasterTransformer-cutlass_kernels

HeyangQin.github.io

RRL

Code for paper Swift Machine Learning Model Serving Scheduling: A Region Based Reinforcement Learning Approach

SimiGrad

Public Code for NIPS submission SimiGrad: Fine-Grained Adaptive Batching for Large ScaleTraining using Gradient Similarity Measurement

tfevent_merger

A helper script to merge tfevent files and correct the relative time. Useful when the training was interrupted and restarted.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

HeyangQin/RRL

Code for paper Swift Machine Learning Model Serving Scheduling: A Region Based Reinforcement Learning Approach

HeyangQin/SimiGrad

Public Code for NIPS submission SimiGrad: Fine-Grained Adaptive Batching for Large ScaleTraining using Gradient Similarity Measurement

HeyangQin/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

HeyangQin/DeepSpeedExamples

Example models using DeepSpeed

HeyangQin/FasterTransformer-cutlass_kernels

HeyangQin/HeyangQin.github.io

HeyangQin/tfevent_merger

A helper script to merge tfevent files and correct the relative time. Useful when the training was interrupted and restarted.

HeyangQin/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs