Dear author, this is a great job, but I encountered a problem. When I wanted to change from single card training to multi card training, my GPUs did not train together. Do you know the reason or can you provide a solution? Thank you very much for your answer
![image](https://private-user-images.githubusercontent.com/56352290/241987976-987327a2-5ab2-4ddd-8214-632583bddf4a.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk5MzYyOTQsIm5iZiI6MTcxOTkzNTk5NCwicGF0aCI6Ii81NjM1MjI5MC8yNDE5ODc5NzYtOTg3MzI3YTItNWFiMi00ZGRkLTgyMTQtNjMyNTgzYmRkZjRhLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzAyVDE1NTk1NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTI0YWEzM2UzYmI5MTUwMGY0NDZkYjk2YWM4YWNkMmQ1ODg0ZDkwNjliYzNiMTBhYWI0NjI3OTY1OGE2MDM5MjQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.lhb5CwBJPSemwTLifW9Hegvfeme_iaM-dHM3oqHExOY)
![image](https://private-user-images.githubusercontent.com/56352290/241988022-113d20cb-d3fb-44f5-b2a2-68a828b73652.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk5MzYyOTQsIm5iZiI6MTcxOTkzNTk5NCwicGF0aCI6Ii81NjM1MjI5MC8yNDE5ODgwMjItMTEzZDIwY2ItZDNmYi00NGY1LWIyYTItNjhhODI4YjczNjUyLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzAyVDE1NTk1NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTg4MzYxNzc2YWIxY2Y4MDZiNGY5NmQ4NWNhYzE4MWY5ZTYzYjRiODMzYzcwOWU0NmFiODM1MGQ2YmI0YzkwZTAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.NzWTH30KQwJ2pd2Q4svaB_P9ljg65iiUzOhmK_e_TpM)