zhaozijie2022/soft-moe
A lightweight pytorch implementation of SoftMoE (Soft Mixture of Experts). Concisely applicable to any sequence of vectorized embeddings. SoftMoE的简洁实现, 几乎适用于所有序列模型, 可以方便地嵌入
Python
No issues in this repository yet.
A lightweight pytorch implementation of SoftMoE (Soft Mixture of Experts). Concisely applicable to any sequence of vectorized embeddings. SoftMoE的简洁实现, 几乎适用于所有序列模型, 可以方便地嵌入
Python
No issues in this repository yet.