2 questions about multi cards training:

[fzhml]

Excuse me.I have 2 questions about multi cards training:1st，in get_batch() function, you choose random pick,Does this result in some data being unable to participate in training?2nd，Besides the card with rank_id=0, did other cards participate in model training? From the logs of my training, it seems that only rank_id=0 has training logs printed.