Dimension mismatch error while trying Instruction tuning

Question

Closed this issue a month ago · 2 comments

Thanks for your work. I am receiving the following error "ValueError: expected sequence of length 142 at dim 1 (got 158)". I think it is due to the following lines
https://github.com/getao/icae/blob/main/code/icae_v2/training_utils.py#L126-L132

where we don't truncate or padding, any suggestions ?

Answer 1 · 2024-08-20T22:32:00.000Z

If the batch size is more than 1, dynamic padding function has to be used.

Answer 2 · 2024-09-12T17:40:20.000Z

Hi I have the same error. Could you share your workaround for the instruction finetuning?