This is the implementation for the paper titled "Enhancing traffic engineering in large-scale networks with Jointly Trained Multi-Agent Reinforcement Learning". The paper is under the reviewing process of ICC 2024. The source code will be made publicly available after the paper is publised.