facebookresearch/FLSim

low test accuracy in Sentiment classification with LEAF's Sent140 tutorial?

ghaccount opened this issue · 0 comments

❓ Questions and Help

Until we move the questions to another medium, feel free to use this as your question:

Question

I tried this tutorial https://github.com/facebookresearch/FLSim/blob/main/tutorials/sent140_tutorial.ipynb
And accuracy is less that random guess (50%)!

Any suggestions or approaches to improve accuracy for this tutorial?

from tutorial:
Running (epoch = 1, round = 1, global round = 1) for Test
(epoch = 1, round = 1, global round = 1), Loss/Test: 0.8683878255035598
(epoch = 1, round = 1, global round = 1), Accuracy/Test: 49.61439588688946
{'Accuracy': 49.61439588688946}