bytedance/lightseq

beam search

hg123-we opened this issue · 0 comments

transformerKernels.cc.cu文件的1406行 int can_pos = num_can_per_beam[blockIdx.x * gridDim.y] + blockIdx.y;应该为int can_pos = num_can_per_beam[blockIdx.x * gridDim.y + blockIdx.y];