bigscience-workshop/Megatron-DeepSpeed

Are there any other layer norm functions, such as RMSNorm or DeepNorm

lvcc2018 opened this issue 2 years ago · 0 comments

lvcc2018 commented 2 years ago

Are there any other layer norm functions, such as RMSNorm or DeepNorm