what is the difference between the modeling_clip and 'lib/python3.9/site-packages/transformers/models/clip/'?
Opened this issue · 1 comments
zimenglan-sysu-512 commented
what is the difference between the modeling_clip and 'lib/python3.9/site-packages/transformers/models/clip/'?
JarrentWu1031 commented
The main difference is that we add an optional ``input_embedding" input for CLIPTextModel forward pass so that the gradient can pass through the learned embedding to our designed I2TNet.