Liuhong99/Sophia

Ambiguous dependency specification

nalzok opened this issue · 1 comments

nalzok commented

Can you provide an environment.yml or requirements.txt? We need the exact version numbers for the purpose of reproducibility. Thanks!

Thanks for mentioning this point! We'll update the requirements.txt soon. For reproducibility, as long as you use PyTorch 2.0 with torch.compile and bfloat16, we believe you can reproduce the results in the paper and the wandb report we provide.