team6 Hello, it is the repository to get familiar with my code Sorry for long code. Please check file main_multi.py Lines 247 with Horovod implementation