Visual-Tuning

A paper list of visual tuning.

Survey

[Adapter] Parameter-Efficient Transfer Learning for NLP | [ICML'19] | [paper] [code]

[LoRA] LoRA: Low-Rank Adaptation of Large Language Models | [ICLR'22] | [paper] [code]
[BitFit/Bias] BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models | [ACL'22] | [paper] [code]
[CoOp] Learning to Prompt for Vision-Language Models | [IJCV'22] | [paper] [code]

[VPT] Visual Prompt Tuning | [ECCV'22] | [paper] [code]
[CoCoOp] Conditional Prompt Learning for Vision-Language Models | [CVPR'22] | [paper] [code]
[AdaptFormer] AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition | [NIPS'22] | [paper] [code]
[NOAH] Neural Prompt Search | [arxiv'22] | [paper] [code]
[SSF] Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning | [NIPS'22] | [paper] [code]
[FacT] FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer | [AAAI23] | [paper]

[RepAdapter] Towards Efficient Visual Adaption via Structural Re-parameterization | [arxiv'23] | [paper] [code]
[GatedPromptTuning] Improving Visual Prompt Tuning for Self-supervised Vision Transformers | [ICML'23] | [paper] [code]
[PVP] PVP: Pre-trained Visual Parameter-Efficient Tuning | [arxiv'23] | [paper]
[E²VPT] E²VPT: An Effective and Efficient Approach for Visual Prompt Tuning | [ICCV'23] | [paper] [code]
[DVPT] Dynamic Visual Prompt Tuning for Parameter Efficient Transfer Learning | [PRCV'23] | [paper]
[ARC] Efficient Adaptation of Large Vision Transformer via Adapter Re-Composing | [NIPS'23] | [paper] [code]