Question about the average test accuracy in the paper
Closed this issue · 2 comments
Hi, I'm very interested in your paper. But I'm confused about Table 1 in the experimental results.
In the original FL formulation, the reward is the same for everyone. In other words, every client gets the same global model. While the paper requires the models to have different performance, commensurate with their contributions. It means that there should be some clients whose model performance is not as good as the performance they get in fedavg. Then why did the clients in the RFFL get a better average test accuracy?
Looking forward to your reply! Thank you.
Thanks for the interest in our work.
See the following:
It means that there should be some clients whose model performance is not as good as the performance they get in fedavg.
This statement is not an entirely accurate description of what happens in our method. It is true that our method intends for the clients to have different models (hence different model performance). For the clients that receive models of relatively lower performance, it is not necessarily true that this performance is lower than that in FedAvg. Let me give a hypothetical example: Suppose that FedAvg obtains a model of performance
So the question is: why/how is it that our method can outperform FedAvg in obtaining a higher test accuracy? The answer is that each client's gradient (or model update) is aggregated based on their reputation (i.e., their reputation is the weight,
I understand. Thanks for your patient response.