/soft-moe

A lightweight pytorch implementation of SoftMoE (Soft Mixture of Experts). Concisely applicable to any sequence of vectorized embeddings. SoftMoE的简洁实现, 几乎适用于所有序列模型, 可以方便地嵌入

Primary LanguagePython

Watchers