Dynamic Federated Learning
This is all you need for a brand new but interesting topic -- dynamic federated learning (DFL), including research papers, datasets, tools, and you name it. Standard federated learning usually assumes that the data distribution, model structure, and participating clients of the overall framework are fixed to unchanged over time. However, DFL explores research problems of training better models (global or personalized) when the aforementioned important elements of FL are dynamically changing. Relevant topics include heterogeneous federated learning, personalized federated learning, incremental learning, continual learning, domain adaptation, and out-of-distribution generalization. We believe dynamic federated learning will be a practical mechanism that can really enable federated learning to be applied in the real world.
Computer Vision
- Non-IID data and Continual Learning processes in Federated Learning: A long road ahead
- (Survey, Information Fusion 2022) [paper]
Pure Classification
- Partitioned Variational Inference: A unified framework encompassing federated and continual learning
- (Arxiv 2018) [paper]
- Federated and continual learning for classification tasks in a society of devices
- (Arxiv 2020) [paper]
- A New Analysis Framework for Federated Learning on Time-Evolving Heterogeneous Data
- (FL-ICML2021) [paper]
- Federated Continual Learning with Weighted Inter-client Transfer
- Federated Class-Incremental Learning
- Learn From Others and Be Yourself in Heterogeneous Federated Learning
- Towards Federated Learning on Time-Evolving Heterogeneous Data
- (Arxiv 2021) [paper]
- Concept drift detection and adaptation for federated and continual learning
- (Multimedia Tools and Applications 2021) [paper]
- Federated Reconnaissance: Efficient, Distributed, Class-Incremental Learning
- ODE: A Data Sampling Method for Practical Federated Learning with Streaming Data and Limited Buffer
- (Arxiv 2022) [paper]
- Diurnal or Nocturnal? Federated Learning from Periodically Shifting Distributions
- (NeurIPS 2022 Workshop) [paper]
- Knowledge Lock: Overcoming Catastrophic Forgetting in Federated Learning
- (PAKDD 2022) [paper]
- Continual Federated Learning Based on Knowledge Distillation
- A Federated Incremental Learning Algorithm Based on Dual Attention Mechanism
- (Applied Science 2022) [paper]
- Tackling Dynamics in Federated Incremental Learning with Variational Embedding Rehearsal
- (Arxiv 2021) [paper]
- Federated Continuous Learning With Broad Network Architecture
- (IEEE Transactions on Cybernetics 2022) [paper]
- Addressing Client Drift in Federated Continual Learning with Adaptive Optimization
- (Preprint 2022) [paper]
- Continual Horizontal Federated Learning for Heterogeneous Data
- (Arxiv 2022) [paper]
- Online Federated Learning via Non-Stationary Detection and Adaptation amidst Concept Drift
- (Arxiv 2022) [paper]
- Better Generative Replay for Continual Federated Learning
- (ICLR 2023) [paper]
- Federated Learning for Data Streams
- (Arxiv 2023) [paper]
- FedKNOW: Federated Continual Learning with Signature Task Knowledge Integration at Edge
- (Arxiv 2022) [paper]
- No One Left Behind: Real-World Federated Class-Incremental Learning
- Federated probability memory recall for federated continual learning
- (Info Science 2023) [paper]
- GradMA: A Gradient-Memory-based Accelerated Federated Learning with Alleviated Catastrophic Forgetting
- (Arxiv 2023) [paper]
- Addressing Catastrophic Forgetting in Federated Class-Continual Learning
- (ICCV 2023) [paper]
- Federated Learning under Distributed Concept Drift
- (AISTATS 2023) [paper]
- Asynchronous Federated Continual Learning
- (CVPR FedVision Workshop 2023) [paper]
- Re-Weighted Softmax Cross-Entropy to Control Forgetting in Federated Learning
- (Arxiv 2023) [paper]
- Distributed Offline Policy Optimization Over Batch Data
- (AISTATS 2023) [paper]
- CoDeC: Communication-Efficient Decentralized Continual Learning
- (Arxiv 2023) [paper]
- Ensemble and continual federated learning for classification tasks
- (Machine Learning 2023) [paper]
- To Store or Not? Online Data Selection for Federated Learning with Limited Storage
- (WWW 2023) [paper]
- Masked Autoencoders are Efficient Continual Federated Learners
- (Arxiv 2023) [paper]
- Semi-supervised federated learning on evolving data streams
- (Information Sciences 2023) [paper]
- A federated learning-based approach to recognize subjects at a high risk of hypertension in a non-stationary scenario
- (Information Sciences 2023) [paper]
- Fed-CPrompt: Contrastive Prompt for Rehearsal-Free Federated Continual Learning
- (FL-ICML 2023) [paper]
- Don't Memorize; Mimic The Past: Federated Class Incremental Learning Without Episodic Memory
- (FL-ICML 2023) [paper]
- FedET: A Communication-Efficient Federated Class-Incremental Learning Framework Based on Enhanced Transformer
- (IJCAI 2023) [paper]
- Federated Multi-Phase Curriculum Learning to Synchronously Correlate User Heterogeneity
- (IEEE Transactions on Artificial Intelligence 2023) [paper]
- Federated Class-Incremental Learning with Prompting
- (Arxiv 2023) [paper]
- FedRCIL: Federated Knowledge Distillation for Representation based Contrastive Incremental Learning
- Distributed Continual Learning with CoCoA in High-dimensional Linear Regression
- (Arxiv 2023) [paper]
- Concept Matching: Clustering-based Federated Continual Learning
- (Arxiv 2023) [paper]
- Spatial-Temporal Federated Learning for Lifelong Person Re-identification on Distributed Edges
- (TCSVT 2023) [paper]
- HePCo: Data-Free Heterogeneous Prompt Consolidation for Continual Federated Learning
- (Arxiv 2023) [paper]
- Decentralized Deep Learning under Distributed Concept Drift: A Novel Approach to Dealing with Changes in Data Distributions Over Clients and Over Time
- (MS Thesis) [paper]
- A Data-Free Approach to Mitigate Catastrophic Forgetting in Federated Class Incremental Learning for Vision Tasks
- (NeurIPS 2023) [paper]
- Accurate Forgetting for Heterogeneous Federated Continual Learning
- (ICLR 2024 submission) [paper]
- Variational Federated Continual Learning
- (ICLR 2024 submission) [paper]
- Towards Out-of-federation Generalization in Federated Learning
- (ICLR 2024 submission) [paper]
- FedGP: Buffer-based Gradient Projection for Continual Federated Learning
- (ICLR 2024 submission) [paper]
- Traceable Federated Continual Learning
- (ICLR 2024 submission) [paper]
- Prototypes-Injected Prompt for Federated Class Incremental Learning
- (ICLR 2024 submission) [paper]
Advanced CV Tasks (object detection, semantic segmentation)
- FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Space
- Federated Incremental Semantic Segmentation
Out-of-Distribution Learning (domain adaptation, domain generalization, out-of-distribution detection)
- Uncertainty-Aware Aggregation for Federated Open Set Domain Adaptation
- (TNNLS 2022) [paper]
- FedSR: A Simple and Effective Domain Generalization Method for Federated Learning
- Federated Domain Generalization for Image Recognition via Cross-Client Style Transfer
- Federated Domain Generalization with Generalization Adjustment
- Rethinking Federated Learning with Domain Shift: A Prototype View
- Turning the Curse of Heterogeneity in Federated Learning into a Blessing for Out-of-Distribution Detection
- Test-Time Robust Personalization for Federated Learning
- PerAda: Parameter-Efficient and Generalizable Federated Learning Personalization with Guarantees
- (Arxiv 2023) [paper]
- FedConceptEM: Robust Federated Learning Under Diverse Distribution Shifts
- (Arxiv 2023) [paper]
- MEC-DA: Memory-Efficient Collaborative Domain Adaptation for Mobile Edge Devices
- (IEEE Transactions on Mobile Computing 2023) [paper]
- FedRC: Tackling Diverse Distribution Shifts Challenge in Federated Learning by Robust Clustering
- (ICLR 2024 submission) [paper]
- A Lightweight Method for Tackling Unknown Participation Statistics in Federated Averaging
- (ICLR 2024 submission) [paper]
- Benchmarking Algorithms for Federated Domain Generalization
- (ICLR 2024 submission) [paper]
- Principled Federated Domain Adaptation: Gradient Projection and Auto-Weighting
- (ICLR 2024 submission) [paper]
- FedNovel: Federated Novel Class Learning
- (ICLR 2024 submission) [paper]
- Federated Generalization via Information-Theoretic Distribution Diversification
- (ICLR 2024 submission) [paper]
- FedOD: Federated Outlier Detection via Neural Approximation
- (ICLR 2024 submission) [paper]
Natural Language Processing
- Federated Learning Of Out-Of-Vocabulary Words
- (Arxiv 2019) [paper]
- Federated Continual Learning for Text Classification via Selective Inter-client Transfer
- (EMNLP Findings 2022) [paper]
- Quantifying Catastrophic Forgetting in Continual Federated Learning
- (ICASSP 2023) [paper]
- FedET: A Communication-Efficient Federated Class-Incremental Learning Framework Based on Enhanced Transformer
- (Arxiv 2023) [paper]
- Coordinated Replay Sample Selection for Continual Federated Learning
- (EMNLP 2023) [paper]
Audio and IoT
- A distillation-based approach integrating continual learning and federated learning for pervasive services
- (Arxiv 2021) [paper]
- FedSpeech: Federated Text-to-Speech with Continual Learning
- (IJCAI 2021) [paper]
- Spatial-Temporal Federated Learning for Lifelong Person Re-identification on Distributed Edges
- (Arxiv 2022) [paper]
- Learnings from Federated Learning in The Real World
- (ICASSP 2022) [paper]
- New Generation Federated Learning
- (Sensors 2022) [paper]
- Attention-based federated incremental learning for traffic classification in the Internet of Things
- (Computer Communications 2022) [paper]
- Federated Learning and catastrophic forgetting in pervasive computing: demonstration in HAR domain
- (IEEE Workshop 2022) [paper]
- Federated Continual Learning through distillation in pervasive computing
- (SmartComp 2022) [paper]
- DILoCC: An approach for Distributed Incremental Learning across the Computing Continuum
- (SmartComp 2022) [paper]
- Cross-FCL: Toward a Cross-edge Federated Continual Learning Framework in Mobile Edge Computing Systems
- (TMC 2022) [paper]
- Urban Traffic Forecasting using Federated and Continual Learning
- (CIoT 2023) [paper]
- ICMFed: An Incremental and Cost-Efficient Mechanism of Federated Meta-Learning for Driver Distraction Detection
- (Mathematics 2023) [paper]
- Personalized Federated Continual Learning for Task-incremental Biometrics
- (IEEE Internet of Things Journal 2023) [paper]
- Continual adaptation of federated reservoirs in pervasive environments
- (Neurocomputing 2023) [paper]
- Continual Federated Learning For Network Anomaly Detection in 5G Open-RAN
- (2023) [paper]
- Age-Aware Data Selection and Aggregator Placement for Timely Federated Continual Learning in Mobile Edge Computing
- (IEEE Transactions on Computers 2023) [paper]
Security Relevant
- GFCL: A GRU-based Federated Continual Learning Framework against Data Poisoning Attacks in IoV
- (Arxiv 2022) [paper]
- Towards a Defense against Backdoor Attacks in Continual Federated Learning
- (Arxiv 2022) [paper]
- Federated Continual Learning with Differentially Private Data Sharing
- (NeurIPS 2022 Workshop) [paper]
- FL-IIDS: A novel federated learning-based incremental intrusion detection system
- (Future Generation Computer Systems 2023) [paper]
- POSTER: Advancing Federated Edge Computing with Continual Learning for Secure and Efficient Performance
- (ANCS 2023) [paper]
Other Topics
- Federated Continual Learning to Detect Accounting Anomalies in Financial Auditing
- (Arxiv 2022) [paper]
- Continual Learning of Dynamical Systems with Competitive Federated Reservoir Computing
- (Arxiv 2022) [paper]
- Towards Lifelong Federated Learning in Autonomous Mobile Robots with Continuous Sim-to-Real Transfer
- (Arxiv 2022) [paper]
- Performative Federated Learning: A Solution to Model-Dependent and Heterogeneous Distribution Shifts
- (Arxiv 2023) [paper]
- Concept Drift Detection and Adaptation for Robotics and Mobile Devices in Federated and Continual Settings
- (Some Workshop 2023) [paper]
- Incremental learning and federated learning for heterogeneous medical image analysis
- (Master Thesis 2023) [paper]
- Continual adaptation of federated reservoirs in pervasive environments
- (Neurocomputing 2023) [paper]
- Peer-to-Peer Federated Continual Learning for Naturalistic Driving Action Recognition
- (CVPR workshop 2023) [paper]