- Pretrain supernet
- Train transformer by training integrated model
- Pretrain supernet
- Build Transbench
- Train Predictor on Transbench
- Train transformer with predictor
cd supernet/
To train one supernet, run
python train_supernet.py --gpu [gpuid] --seed [seed_num]
After training complete, copy supernet and twin supernet to ${workspaceFolder}/supernet/selected_supernet
and rename them to supernet.pt
and supernet_twin.pt
cd integrated_models/nat_disguiser
And run,
python net_disguiser.py --gpu [gpuid]
cd transbench
If you want to build transbench yourself,
cd high_fidelity
And run,
python build_high_fidelity_transbench.py
The already build transbench written in yaml
is in data/high_fidelity
cd predictors
If you want to train high fidelity predictor,
cd high_fidelity
python finetune_predictor.py
The config file of predictor and the config file of optimization detail is in the two yamls.
The code is in
integrated_models/predictor_based
The code is in
final_test/compile_based