This allows using P2P on 4090 GPUs with the 570.124.04 driver version. See https://github.com/tinygrad/open-gpu-kernel-modules for more info.
- Install https://www.nvidia.com/en-us/drivers/details/242273/
- Run
./install.sh - Reboot
- ensure iommu is disabled in bios
- install https://www.nvidia.com/en-us/drivers/details/242273/
- clone https://github.com/aikitoria/open-gpu-kernel-modules/tree/570.133.07-p2p
- run install.sh in there
- reboot
- run a program that uses nccl with NCCL_P2P_LEVEL=SYS