/soft-moe

PyTorch implementation of "From Sparse to Soft Mixtures of Experts"

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers