Pinned Repositories
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
intel-extension-for-deepspeed
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
flash-attention
Fast and memory-efficient exact attention
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
intel-extension-for-deepspeed
Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note XPU is already supported by stock DeepSpeed.
DeepSpeedSYCLSupport
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
YizhouZ's Repositories
YizhouZ/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
YizhouZ/Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
YizhouZ/intel-extension-for-deepspeed