Where is the CLIP-Adapter code, please?

Question

Where is the CLIP-Adapter code, please?

Closed this issue 2 years ago · 5 comments

machengcheng2016 commented 2 years ago

Greetings! Really fantastic work!
But where is the CLIP-Adapter code? I wonder how is the two-layer MLP in CLIP-Adapter structured.

Answer 1 · 2022-07-19T10:24:22.000Z

According to your papers, there is a two-layer MLP adapter for the language branch in CLIP-Adapter, but there is not in TIP-Adapter. Am I right?

Answer 2 · 2022-07-19T10:38:52.000Z

Thanks for your interest on our work. The CLIP-Adapter code is partly released at here, where shows how two-layer MLP structured. We will complete it soon.

https://github.com/gaopengcuhk/CLIP-Adapter

Answer 3 · 2022-07-19T10:39:37.000Z

Yes, but the best-performing version of CLIP-Adapter only contains visual adapter like Tip-Adapter.

Answer 4 · 2022-07-19T10:42:35.000Z

I see. It seems there is also no adapter for the text branch in CLIP-Adapter.
Is this because the text adapter is useless compared with the image adapter?

Answer 5 · 2022-07-19T10:46:23.000Z

Yeah I found corresponding experimental results in the CLIP-Adapter paper. Thanks anyway!