[Help]有没有人尝试过把优化器改成SGD来减少显存占用的
31-ryougishiki opened this issue · 1 comments
31-ryougishiki commented
Is there an existing issue for this?
- I have searched the existing issues
Current Behavior
我看代码里使用的优化器好像是transformers自带的adamw，是不是可以换成SGD减少显存。
Expected Behavior
No response
Steps To Reproduce
无
Environment
无Anything else?
No response
hhy150 commented
你好，请问在哪里看到优化器的设置呢？