FEAT: support collective communication
qianduoduo0904 opened this issue · 0 comments
qianduoduo0904 commented
Is your feature request related to a problem? Please describe
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Collective communication is widely used for deep learning workload, we can add support for it.