hemingkx/SpecDec

Codes for our paper "Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation" (EMNLP 2023 Findings)

Python

Issues

Would you like to share your distilled datasets ?
#3 opened 2 years ago by boom-R123
0
error while running inference.sh in summarization module error: argument --task: invalid choice: 'translation_lev_modified'
#2 opened 2 years ago by vfbi
5
is GAD faster than fairseq decode?
#1 opened 3 years ago by weitaizhang
8