HLTCHKUST/VG-GPLMs

Question about the code

Closed this issue · 1 comments

haruhi-sudo commented

Hi, thanks for your awesome work! I have a question about the code:

VG-GPLMs/src/data_preprocess/data_builder.py

Line 30 in d27a485

self.src = [" ".join(item.split()[1:]) for item in self.src]

Why did you ignore the first word in the src and tgt?
Looking forward to your reply.

TysonYu commented

Hi,
Actually, the first word is not a word but the sample ID, which is a number, if you download the date from the way I suggested in the readme.