/minMOE

Minimal PyTorch re-implementation of MOE-architecture with various gate options and technical tricks

Apache License 2.0Apache-2.0

minMOE

Minimal PyTorch re-implementation of MOE-architecture with various gate options and technical tricks