/FedGELA

[NeurIPS 2023]Federated Learning with Bilateral Curation for Partially Class-Disjoint Data

Primary LanguagePython

FedGELA

[NeurIPS 2023]Federated Learning with Bilateral Curation for Partially Class-Disjoint Data

Dependencies

  • PyTorch >= 1.0.0
  • torchvision >= 0.2.1
  • scikit-learn >= 0.23.1

Data Preparing

Here we provide the implementation on SVHN, Cifar-10 and Cifar100 datasets. The three datasets will be automatically downloaded in your datadir.

Model Structure

As for model used in the paper, we use the same model structure ResNet18 modified for 32x32 input as MOON.

Parameters

Parameter Description
proxy Type of last layer of classifier you used (cls for FedAvg and etf for our FedGELA).
model The model architecture. Options: simple-cnn, resnet18.
dataset Dataset to use. Options: CIFAR10. CIFAR100, SVHN
lr Learning rate.
batch-size Batch size.
epochs Number of local epochs.
n_parties Number of parties.
party_per_round number of active clients in each round.
comm_round Number of communication rounds.
beta The concentration parameter of the Dirichlet distribution for non-IID partition. Setting 100000 as IID
datadir The path of the dataset.
logdir The path to store the logs.
seed The initial seed.
temperature Temperature in MOON and Ew in our paper.
mu Param of baselines.

Usage

Here is an example to run FedGELA on CIFAR10 with ResNet18:

python FedGELA.py --dataset=cifar10 \
    --partition='dirichlet' \
    --temperature=0.00001 \
    --lr=0.01 \
    --epochs=10 \
    --model=resnet18 \
    --comm_round=100 \
    --n_parties=50 \
    --beta=0.5 \
    --party_per_round=10 \
    --logdir='./logs/' \
    --datadir='./data/' \
    --proxy='etf' \

Acknowledgement

We borrow some codes from MOON and FedSkip.

Contact

If you have any problem with this code, please feel free to contact zqfan_knight@sjtu.edu.cn or ziqingfan0331@gmail.com.

Cite

If you find it useful, please cite as following:

@inproceedings{fan2023federated,
  title={Federated Learning with Bilateral Curation for Partially Class-Disjoint Data},
  author={Fan, Ziqing and Zhang, Ruipeng and Yao, Jiangchao and Han, Bo and Zhang, Ya and Wang, Yanfeng},
  booktitle={Thirty-seventh Conference on Neural Information Processing Systems},
  year={2023}
}