beichenzbc/Long-CLIP

Issues

• Reason for tokenizing to 77*4-60 tokens

  #72 opened a month ago by ivonajdenkoska
  1

• [Question] How did you evaluate the effective length of CLIP.

  #71 opened a month ago by FangGet
  8

• A question

  #65 opened a month ago by xylovezxy
  1

• Extra memory being used in training loop

  #63 opened a month ago by rsomani95
  1

• PCA numerically appears to do very little / nothing

  #68 opened a month ago by damian0815
  1

• Long caption-image retrieval with CLIP tokenizers?

  #69 opened a month ago by ivonajdenkoska
  3

• PCA issue

  #52 opened 2 months ago by mikelee-dev
  4

• 微调LongCLIP-L时报错

  #70 opened 2 months ago by XLMore
  3

• model

  #40 opened 3 months ago by ucasyjz
  4

• RoPE for Long-CLIP - perfect match for Flux?

  #67 opened 2 months ago by zer0int
  1

• Cannot import

  #66 opened 2 months ago by Elminsst
  0

• 中文支持吗

  #58 opened 2 months ago by gujiacheng
  2

• Release of ShareGPT4V random 1k pairs for evaluation

  #60 opened 2 months ago by ivonajdenkoska
  6

• About maintaining the retrieval ability of short text after fine-tuning cn_clip

  #64 opened 2 months ago by XA-hyy
  2

• continuing pre-training

  #50 opened 2 months ago by mikelee-dev
  3

• Trainable layers in Text + Image Encoder

  #56 opened 2 months ago by mikelee-dev
  1

• 显存占用问题

  #61 opened 2 months ago by Lil-CC
  5

• Question re. Label Smoothing

  #62 opened 2 months ago by rsomani95
  6

• how to extract word and spatial feature

  #57 opened 3 months ago by bo-miao
  4

• Summarized short captions of ShareGPT4v for training

  #59 opened 2 months ago by ivonajdenkoska
  1

• 即插即用的问题

  #55 opened 3 months ago by SnailForce
  3

• PCA In the inference stage.

  #53 opened 3 months ago by exiawsh
  2

• License

  #54 opened 3 months ago by jaretburkett
  2

• LongCLIP with SDXL

  #27 opened 3 months ago by SnailForce
  1

• Error during PCA computation

  #51 opened 3 months ago by mikelee-dev
  0

• Installable package

  #49 opened 3 months ago by sandstorm12
  0

• Does the input size increases?

  #31 opened 3 months ago by lucasjinreal
  3

• How to use long clip in diffusers?

  #37 opened 3 months ago by SnailForce
  3

• How to process text longer than 248?

  #38 opened 3 months ago by ZihaoZheng98
  3

• the effect of different values of 'alpha' in loss

  #39 opened 3 months ago by YiguoHe
  2

• Inpressing work! Having some questions about "Long-Clip"

  #41 opened 3 months ago by psp3dcg
  2

• A potential risk of text comprehension ability

  #47 opened 3 months ago by OnceMonkey
  1

• what is the difference between longclip-b and longclip-l?

  #48 opened 3 months ago by mikelee-dev
  1

• Evaluation code for long-caption text-image retrieval.

  #24 opened 5 months ago by lygsbw
  4

• can put ShareGPT4V dataset into huggingface?

  #43 opened 3 months ago by zimenglan-sysu-512
  4

• error about python sdxl.py?

  #44 opened 3 months ago by SnailForce
  2

• Can you release a demo on using long clip with SD1.5 as mentioned in Fig. 6 of your paper?

  #46 opened 3 months ago by SnailForce
  1

• [rank2]: AttributeError: module 'torch.distributed' has no attribute 'nn'

  #45 opened 3 months ago by zimenglan-sysu-512
  1

• how to fine-tune LongCLIP on a single-node, single-GPU setup

  #36 opened 4 months ago by YiguoHe
  3

• Training

  #42 opened 3 months ago by ucasyjz
  3

• 微调LongClip

  #34 opened 4 months ago by nimtecv
  4

• would you please provide more detailed instructions for fine-tuning Long-CLIP?

  #35 opened 4 months ago by YiguoHe
  4

• Geometric Parameterization (GmP) of MLP and fine-tuning on CoCo-40k-SPRIGHT (spatially-right long-labels) eliminates typographic attack vulnerability in Long-CLIP (but not short-CLIP 77 tokens) + improves ImageNet/ObjectNet accuracy.

  #29 opened 5 months ago by zer0int
  2

• Please provide weight file with Baidu Cloud .

  #32 opened 4 months ago by TheGreatTreatsby
  2

• Error in "how to use" code

  #33 opened 4 months ago by yg-smile
  1

• Can you provide the weights of LongClip B/32

  #23 opened 4 months ago by ShiShuMo
  1

• Code

  #26 opened 4 months ago by SnailForce
  3

• TypeError

  #30 opened 4 months ago by xylovezxy
  2

• <image> tag in json file

  #28 opened 5 months ago by Quest2GM
  3

• Fail in modeling interrelationship

  #25 opened 5 months ago by jiashenggu
  0