Pinned Repositories
transpeeder
train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
neox-LLAMA2
update neox framework to train llama1&llama2
transpeeder
train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
transpeeder_rlhf
support llama,qwen,deepseek等结构的强化训练代码，包括ppo，dpo等
transpeeder_rlhf
support llama,qwen,deepseek等结构的强化训练代码，包括ppo，dpo等
JHU_CS675_Project_SentimentAnalysisonMovieReviews
JY-Ren's Repositories
JY-Ren/transpeeder
train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
JY-Ren/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
JY-Ren/neox-LLAMA2
update neox framework to train llama1&llama2
JY-Ren/transpeeder_rlhf
support llama,qwen,deepseek等结构的强化训练代码，包括ppo，dpo等