Questions about Aspect accuracy
ayanesakura opened this issue · 4 comments
Hello,I have read your paper,excellent work! But in the paper you may did not mention how the accuracy is calculated, now I know the sentiment ACC is ACC of the classification task of sentence-pairs,but how about aspect acc?
Hi, aspect acc is the strict acc defined in [1]:
[1] Yukun Ma, Haiyun Peng, and Erik Cambria. 2018. Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive lstm. In Proceedings of AAAI.
Thank you for your reply， I calculated the apsect acc in that way, result is as below,the red is my result and the black is result in paper.
The sentiment acc is close to result in paper but the apsect accrate is too bad, maybe the reason is that the Bert model I used is different from the paper? I used the uncased_L-12_H-768_A-12 bert model. Or other reasons?
Did you use the "evaluation.py" file in the evaluation step? If not, you may use it:
python evaluation.py --task_name sentihood_NLI_M --pred_data_dir results/sentihood/NLI_M/test_ep_4.txt
Oh! I'm such an idiot, thank you!