OptimalScale/LMFlow

RAFT Issues

Opened this issue · 2 comments

jujipotle commented

Hello,
I am trying to replicate RAFT, but am running into several issues when running ./scripts/run_raft_align.sh. I've tried both the main LMFlow branch and the LMFlow_RAFT_Dev subbranch, but both seem to be outdated. Have the authors or anyone else tried running RAFT and had it work? What branch was used to produce the results from the original RAFT paper?

research4pan commented

Thanks for your interest in LMFlow! The latest RAFT will be integrated soon (#867). For temporary usage, you may try this script https://github.com/RLHFlow/Online-RLHF/blob/main/run_loop.sh by changing --loss_type sigmoid in line 33 to --loss_type raft first. Hope this information can be helpful 😄

jujipotle commented

Thanks for the quick response! So if I want to replicate the RAFT paper, I can only do so through RLHFlow, and not LMFlow?