How many rules are there in TASO now?
puddingfjz opened this issue · 2 comments
puddingfjz commented
Hi, now how many transformation rules are used in TASO?
jiazhihao commented
@puddingfjz Thanks for your interests in TASO. TASO currently uses around 700 default substitutions, and you can easily customize the substitutions you want to explore by running https://github.com/jiazhihao/TASO/blob/master/src/generator/generator.cc. Line 1731-1783 specifies the set of operators you want TASO to use when generating substitutions.
puddingfjz commented
When I try to optimize BERT (use the example provided by TASO), I find the final optimization sequence only has 24 steps. The GPU I use is NVIDIA Tesla P100.
Besides, I also want to ask whether current TASO jointly optimize the data layout as mentioned in the paper?