Can fastBPE use the subword codes file?
SefaZeng opened this issue · 0 comments
SefaZeng commented
I use the fastBPE to apply bpe to make it faster. But I want to use the origin codes file learned from subword. And I found a clean difference between the two results. Is it because fastBPE cannot use the codes file learned from subword?