TsinghuaAI/InfMoE

Inference framework for MoE layers based on TensorRT with Python binding