XLA CollectiveOpsUtil does not include kReduceScatter
Closed this issue · 2 comments
ptoulme-aws commented
When debugging the XLA while loop unroller channel id creation, we found that HloOpcode::kReduceScatter was not included as a collective to generate new channel id for.
While loop unroller location:
xla/xla/service/while_loop_unroller.cc
Line 201 in 79d745f
Collective ops util location:
xla/xla/service/collective_ops_utils.cc
Line 611 in 79d745f
We have added kReduceScatter locally and it fixed our channel id issues.
Questions:
- Why is kReduceScatter not listed in the list of collective operations to replace channel id with?
- Can kReduceScatter be added to the list if this is a bug?
akuegel commented
I think it is fixed, please let us know in case this is still a problem.