Sun-Shiqi opened this issue 9 months ago · 1 comments
When I run the demo ( step3_rlhf_finetuning/training_scripts/opt/single_node/run_1.3b.sh) without any change , the reward dose not increase. Is it normal? I would appreciate it if anyone can provide a normal reward curve .
this is my reward curve
