Multi-GPU

This repo contains cuda programs which can running on Multi-GPUs using data-paral or model-paral.