openpsi-project/ReaLHF

Loading parameters takes exceptionally long time.

nuzant opened this issue · 1 comments

In current version, loading parameters (llama2-7b) takes exceptionally long time (~2mins). There might be a bug in model loading.

Solved by #20