how to implement multi-gpu for training?

[DavidKong96]

thanks for your sharing.
but how can i implement multi-gpu for training？and how to raise batchsize to more than 1?
thanks !