/Federated-AI-research

Primary LanguagePythonApache License 2.0Apache-2.0

Trustworthy Federated Learning Research

This repository contains research works and projects on trustworthy federated learning. It includes:

  1. Datasets. Preprocessing codes of datasets we used and developed for federated learning research.
  2. Publications. Implementation codes of our publications.
  3. Projects. Other projects in federated learning.

Federated Learning Portal

This webportal keeps track of books, workshops, conference special tracks, journal special issues, standardization effort and other notable events related to the field of Federated Learning (FL).

NEWS

2022-05-13 #Call for papers. International Workshop on Trustworthy Federated Learning in Conjunction with IJCAI 2022 (FL-IJCAI'22))

2022-01-15 #Call for papers. https://www.computer.org/digital-library/journals/bd/call-for-papers-special-issue-on-trustable-verifiable-and-auditable-federated-learning

Datasets

Dataset Description
Street Dataset A real-world object detection dataset that annotates images captured by a set of street cameras based on object present in them, including 7 object categories.
Fed_ModelNet40 It consists of images taken from various views of 3D models, and can be used for vertical federated learning research.
NUS WIDE To simulate a vertical federated learning setting, the image features of samples is put on one party and the textual tags on another party.
CheXpert CheXpert is a large dataset of chest X-rays and can be used for vertical federated learning research.

Publications

Our publications are categorized as below:

  • Highlight. Our newly and highly interesting works.
  • Paradigm. Various types of federated learning schemes.
  • Security. Data privacy and model security.
  • Efficiency. Communication and computation efficiency, data distribution heterogeneity, system interpretability and Incentive Mechanism.
  • Incentive. Incentive Mechanism.
  • Application. Federated learning in real-world applications.
  • Dataset. Datasets for federated learning research.
  • Survey. Survey on various topics of federated learning.

Highlight

Title Code Description
No Free Lunch Theorem for Security and Utility in Federated Learning Under review, New theorem for secure federated learning
FedIPR: Ownership Verification for Federated Deep Neural Network Models code IEEE Transactions on Pattern Analysis and Machine Intelligence 2022
SecureBoost: A Lossless Federated Learning Framework code IEEE intelligent Systems 2021, widely-used federated tree-boosting algorithm
A Secure Federated Transfer Learning Framework code IEEE intelligent Systems 2020, the first federated transfer learning paper
FedVision: An Online Visual Object Detection Platform Powered by Federated Learning code AAAI 2020, Innovative Application of Artificial Intelligence Award from AAAI in 2020
Federated machine learning: Concept and applications ACM TIST 2019, the 3rd most cited federated learning paper

Paradigm

Title Code Description
FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data ICML FL workshop 2020
A Secure Federated Transfer Learning Framework code IEEE intelligent Systems 2020
FedCVT: Semi-supervised Vertical Federated Learning with MultiView Training ACM TIST 2022
Federated Transfer Reinforcement Learning for Autonomous Driving code
Privacy-preserving Heterogeneous Federated Transfer Learning IEEE BigData 2019
SecureBoost: A Lossless Federated Learning Framework code IEEE intelligent Systems 2021
Multi-Component Transfer Metric Learning for handling unrelated source domain samples Knowledge-Based Systems
Cross-silo Federated Neural Architecture Search for Heterogeneous and Cooperative Systems code Self-supervised Vertical Federated NAS

Security and Privacy

Title Code Description
FedCG: Leverage Conditional GAN for Protecting Privacy and Maintaining Competitive Performance in Federated Learning code IJCAI2022
FedIPR: Ownership Verification for Federated Deep Neural Network Models IEEE Transactions on Pattern Analysis and Machine Intelligence
Protecting Intellectual Property of Generative Adversarial Networks from Ambiguity Attack CVPR 2021
Backdoor attacks and defenses in feature-partitioned collaborative learning code ICML 2020 FL workshop
Secure Federated Matrix Factorization IEEE Intelligent Systems 2020
Privacy-Preserving Deep Learning with SPDZ The AAAI Workshop on PPAI
Batchcrypt: Efficient homomorphic encryption for cross-silo federated learning USENIX 2020 ATC
Privacy Threats Against Federated Matrix Factorization IJCAI 2020 FL workshop
Dynamic backdoor attacks against federated learning
Rethinking Privacy Preserving Deep Learning: How to Evaluate and Thwart Privacy Attacks Springer Book 2020
Rethinking Deep Neural Network Ownership Verification: Embedding Passports to Defeat Ambiguity Attack code NIPS 2019
Abnormal client behavior detection in federated learning NIPS workshop 2019

Efficiency

Title Code Description
FLASHE: Additively Symmetric Homomorphic Encryption for Cross-Silo Federated Learning Arxiv 2021
Batchcrypt: Efficient homomorphic encryption for cross-silo federated learning code 2020 USENIX ATC 2020
A Communication Efficient Collaborative Learning Framework for Distributed Features NeurIPS 2019 FL workshop
RPN: A Residual Pooling Network for Efficient Federated Learning ECAI 2020
Secure and Efficient Federated Transfer Learning IEEE BigData 2019

Incentive

Title Code Description
Contribution-Aware Federated Learning for Smart Healthcare IAAI 2022
A Fairness-aware Incentive Scheme for Federated Learning AIES 2020
A Sustainable Incentive Scheme for Federated Learning IEEE Intelligent Systems
A multi-player game for studying federated learning incentive schemes IJCAI 2020

Application

Title Code Description
StarFL: Hybrid Federated Learning Architecture for Smart Urban Computing ACM TIST 2021
Variation-Aware Federated Learning with Multi-Source Decentralized Medical Image Data IEEE Journal of Biomedical and Health Informatics 2020
Fedml: A research library and benchmark for federated machine learning code NeurIPS 2020 FL workshop
Federated Transfer Learning for EEG Signal Classification code IEEE EMBC 2020
Multi-Agent Visualization for Explaining Federated Learning IJCAI 2019
HHHFL: Hierarchical Heterogeneous Horizontal Federated Learning for Electroencephalography IJCAI FL workshop 2020
FedVision: An Online Visual Object Detection Platform Powered by Federated Learning code AAAI 2020
Fair and Explainable Dynamic Engagement of Crowd Workers IJCAI 2019
Privacy-Preserving Technology to Help Millions of People: Federated Prediction Model for Stroke Prevention IJCAI 2020 FL workshop

Dataset

Title Code Description
Real-World Image Datasets for Federated Learning code NIPS FL workshop 2019

Survey

Title Code Description
Toward Responsible AI: An Overview of Federated Learning for User-centered Privacy-preserving Computing ACM TIST 2022
Towards Personalized Federated Learning IJCAI FL workshop 2021
Advances and Open Problems in Federated Learning Foundations and Trends in Machine Learning 2021
Threats to Federated Learning: A Survey IJCAI FL workshop 2020
Towards Utilizing Unlabeled Data in Federated Learning: A Survey and Prospective ArXiv 2020
Federated machine learning: Concept and applications ACM TIST 2019

Projects

Currently, we are actively contributing to two projects, FedML (research-origented) and FATE (application-oriented).

FedML (Federated Machine Learning) is a research-oriented Federated Learning Library. It provides a plenty of out-of-the-box modules in federated learning, which greatly facilitates the development of new federated learning algorithms for researchers. We are co-contributor to this project and mainly maintain the part of vertical federated learning.

FATE (Federated AI Technology Enabler) is an industrial grade Federated Learning framework. It has already incorporated many of our proposed methods and algorithms to enhance its security and efficiency under various federated learning scenarios. Some of the implemented algorithms are listed below:

License

Apache 2.0 license.