salesforce/CodeT5

70x slower generation time with codet5p_2b compared to codet5p_770m

natashabutt opened this issue · 0 comments

natashabutt commented

My generation time is 70x higher with codet5p_2b compared to codet5p_770m for the same input text. Why is this?