Congestion-aware Multi-agent Trajectory Prediction for Collision Avoidance