OpenPPL/ppl.pmx

TYPO in “ppl.pmx/docs/operators/dynamic_batching/MultiHeadAttention.md”

Closed this issue · 2 comments

wplf commented

Is the 'togather' supposed to be 'together' in “ppl.pmx/docs/operators/dynamic_batching/MultiHeadAttention.md” ?

Because dynamic batching will combine decoding attention and first-fill attention togather, we have to pass some information to separate input into two part by decoding_batches.

Alcanderian commented

Yes, it is. Thanks for pointing out the typo