[Doc] Inquiry on MSCCL++ Algorithms

[jhlee508]

Hi, mscclpp's developers. I am just curious about the algorithms that mscclpp uses.

Direct information on MSCCL++ is hard to find in public resources, especially regarding whether it is an extension or modification of NCCL, and whether it uses algorithms other than Ring or Tree.

If you could provide any details on whether it utilizes standard algorithms like Ring or Tree, or if it employs different algorithms, that would be helpful.

Thank you.

[chhwang]

@jhlee508 MSCCL++ is a completely separate project from NCCL. A small part of our code is borrowed from NCCL and NVIDIA-licensed, though (in v0.4.2, debug.cc, socket.cc, debug.h, and utils_internal.hpp).

MSCCL++ itself does not implement any collective communication algorithm. MSCCL++ users are supposed to do that. We have a few example algorithms in our test code.