yangshao opened this issue 3 years ago · 1 comments
你好,关于allreduce的rpc https://github.com/zackchen/MatrixSlow/blob/9c400dd97e1a776a9632a8ed3b9f6b7cf0585c94/matrixslow/trainer/dist_trainer.py#L155 和 https://github.com/zackchen/MatrixSlow/blob/9c400dd97e1a776a9632a8ed3b9f6b7cf0585c94/matrixslow/trainer/dist_trainer.py#L158 这两行的顺序重要么?L155会不会一直block?