X-PLUG/mPLUG-Owl

Question for mplug-owl v1 model code

Opened this issue · 0 comments

Hey, I have a quick question about modeling_mplug_owl.py.

What does the following line do??

torch.ones(query_features.size()[:-1], dtype=torch.long).to(query_features.device)

It seems the line is meaningless, or there is some missing variable, like the attention mask.

Thanks in advance!