Wang-Yu-Qing/MMOE

Multi-gate Mixture-of-Experts (MMOE)

MMOE

Implementation of paper 《Modeling Task Relationships in Multi-task Learning with Multi-gate Mixture-of-Experts》

Dataset

census data set from PaddleRec

Run

• create data and data/tfrecords folders
• download and move train_data.csv and test_data.csv to data folder
• Run with default config: python main.py

Key points

• batch norm for census data

TODOs

• try tencent video data set
• MMOE with attention
• grad norm