Doubts in Inference and Training

[codemaster-22]

Hey why are we not maintaining something like blank token during Inference for each time step , and during training also won't there be some alignment problems ?

[sooftware]

Sorry for late response. I handle blank token when converts ids to tokens. like this.