Improve testing for composable FSDP
rohan-varma opened this issue · 0 comments
rohan-varma commented
🚀 The feature
Should add some tests to ensure the right sharded grad scaler, no_sync ctx manager, etc is picked out when using composable FSDP
Motivation, pitch
.
Alternatives
No response
Additional context
No response