yuniaXian/ppo_llm_DeepSpeed

Customized llm PPO (reinforcement learning) pipeline with deepSpeed. For Amex external usage. Training reward model, actor-critic models with referenced supervised fine-tuned model

PythonApache-2.0