Make decoding incremental in AttentionDecoder.forward()
brendon-boldt opened this issue · 0 comments
brendon-boldt commented
In order to allow for beam search and more efficient autoregressive deocding, the forward() method of AttentionDecoder needs to be reworked.