/Transfer-learning-trends

A collection of trends about transfer learning

MIT LicenseMIT

Trends of transfer learning

The resources focus on the latest papers in arXiv, some useful sources, the excellent scholars, and most importantly, the trends of transfer learning from top conferences and journals. You are welcome to pull any requests as you will. I'll sort out the content soon.

New papers in arXiv

Useful websites

Other githubs

Excellent scholars

Scholar Scholar Scholar
Qiang Yang Sinno Jialin Pan NTU 龙明盛 清华大学
Boqing Gong Google 庄福振 中科院计算所 李文 ETH
张宇 南方科技大学 张磊 重庆大学 Lixin Duan Amazon
Sheng Li Univ. of Georgia Zhengming Ding Purdue Univ. Judy Hoffman Georgia Tech
Meina Kan ICT, CAS Kate Saenko Boston Univ. Jian Liang NUS
Mingkui Tan SCUT Kuniaki Saito Boston Univ. Jing Zhang Beihang Univ.
Zirui Wang CMU Zhao Han CMU Hao Lu HUST
Tatiana Tommasi

Trend papers

Year 2020

Title Conf./Journal Code Keywords Benefit
42 Universal Domain Adaptation through Self Supervision (paper) NeurIPS 2020 self supervision
41 Transferable Calibration with Lower Bias and Variance in Domain Adaptation (paper) NeurIPS 2020 bias and variance
40 Learning to Adapt to Evolving Domains NeurIPS 2020 evolving TL
39 Adapting Neural Architectures Between Domains NeurIPS 2020 adapting NN
38 Robust Optimal Transport with Applications in Generative Modeling and Domain Adaptation (paper) NeurIPS 2020 OT
37 On Adaptive Distance Estimation (paper) NeurIPS 2020 distance
36 Hierarchical Granularity Transfer Learning NeurIPS 2020
35 CO-Optimal Transport (paper) NeurIPS 2020 OT
34 A Combinatorial Perspective on Transfer Learning (paper) NeurIPS 2020
33 AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning (paper) NeurIPS 2020 multi-task learning
32 Domain Adaptation with Conditional Distribution Matching and Generalized Label Shift (paper) NeurIPS 2020 label shift
31 On the Theory of Transfer Learning: The Importance of Task Diversity (paper) NeurIPS 2020 task diversity
30 A Unified View of Label Shift Estimation (paper) NeurIPS 2020 label shift
29 Transfer Learning via L1 Regularization (paper) NeurIPS 2020
28 Group Knowledge Transfer: Collaborative Training of Large CNNs on the Edge (paper) NeurIPS 2020 knowledge transfer
27 An Imitation from Observation Approach to Sim-to-Real Transfer (paper) NeurIPS 2020 sim-to-real transfer
26 Learning Fair and Transferable Representations (paper) NeurIPS 2020 fair TL
25 Minimax Lower Bounds for Transfer Learning with Linear and One-hidden Layer Neural Networks (paper) NeurIPS 2020 lower bounds
24 Do Adversarially Robust ImageNet Models Transfer Better? (paper) NeurIPS 2020 code transferability good question
23 What is being transferred in transfer learning? (paper) NeurIPS 2020 deep TL interesting
22 LEEP: A New Measure to Evaluate Transferability of Learned Representations (paper) ICML 2020 new metric for transferability negative transfer
21 Label-Noise Robust Domain Adaptation (paper) ICML2020 label noise
20 Estimating Generalization under Distribution Shifts via Domain-Invariant Representations (paper) ICML 2020 code new theory recommend
19 Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptation (paper) ICML 2020 code source-free DA new trend
18 Graph Optimal Transport for Cross-Domain Alignment (paper) ICML 2020 optimal transport connection with GCN
17 Understanding Self-Training for Gradual Domain Adaptation (paper) ICML 2020 gradual DA new trend
16 Continuously Indexed Domain Adaptation (paper) ICML 2020 domain index distribution new direction
15 Implicit Class-Conditioned Domain Alignment for Unsupervised Domain Adaptation (paper) ICML 2020 code Implicit alignment recommend
14 Self-supervised Label Augmentation via Input Transformations (paper) ICML 2020 code self-supervised ideas can be used to many tasks
13 Open Compound Domain Adaptation (paper) CVPR 2020 code real life transfer new trend
12 Rethinking Class-Balanced Methods for Long-Tailed Visual Recognition from a Domain Adaptation Perspective (paper) CVPR 2020 DA in long-tailed data new trend
11 Unsupervised Domain Adaptation via Structurally Regularized Deep Clustering (paper) CVPR 2020 code cluster
10 Model Adaptation: Unsupervised Domain Adaptation without Source Data (paper) CVPR 2020 privacy new problem
9 Towards Inheritable Models for Open-Set Domain Adaptation (paper) CVPR 2020 code open set DA
8 Extending and Analyzing Self-Supervised Learning Across Domains (paper) ECCV 2020 self-supervised
7 Collaborative Graph Convolutional Networks: Unsupervised Learning Meets Semi-Supervised Learning (paper) AAAI 2020 GCN
6 Discriminative Adversarial Domain Adaptation (paper) AAAI 2020 code discriminative information recommend
5 Multi-Source Distilling Domain Adaptation (paper) AAAI 2020 multi-source
4 Unsupervised Domain Adaptive Graph Convolutional Networks (paper) WWW 2020 GCN+DA
3 Visualizing Transfer Learning (paper) WHI 2020 code visualize properties interesting
2 A survey on domain adaptation theory: Learning bounds and theoretical guarantees (paper) arXiv 2020 theory recommend
1 Overcoming Negative Transfer: A Survey (paper) arXiv 2020 negative transfer

Year 2019

Title Conf./Journal Code Keywords Benefit
11 Catastrophic Forgetting Meets Negative Transfer: Batch Spectral Shrinkage for Safe Transfer Learning (paper) NIPS 2019 negative and safe TL recommend
10 Transferable Normalization: Towards Improving Transferability of Deep Neural Networks (paper) NIPS 2019 code new normalization
9 On the Value of Target Data in Transfer Learning (paper) NIPS 2019 sampling costs recommend
8 Learning search spaces for Bayesian optimization: Another view of hyperparameter transfer learning (paper) NIPS 2019 Bayesian optimization
7 Learning classifiers for target domain with limited or no labels (paper) ICML 2019 code zero/few shot learning
6 Learning What and Where to Transfer (paper) ICML 2019 meta-TL new trend
5 On Learning Invariant Representation for Domain Adaptation (paper) ICML 2019 theory
4 Do better ImageNet models transfer better? (paper) CVPR 2019 transferability good question
3 Characterizing and Avoiding Negative Transfer (paper) CVPR 2019 negative transfer
2 Transferable Curriculum for Weakly-Supervised Domain Adaptation (paper) AAAI 2019 curriculum learning+DA
1 Parameter Transfer Unit for Deep Neural Networks (paper) PAKDD 2019 new unit good idea

Contact

  • Wen Zhang - wenzn9 [at] gmail.com

If you are interested in contributing to this repository, welcome to contact me by e-mail.