HLTCHKUST/sensational_headline

problem about rouge score

river0tter opened this issue · 2 comments

Hi, I was confusing that why you use "article" as the ground truth to compute rouge score in the below codes? However, as you mentioned in the paper, it seemed that y* should be "headline".
THX :)

Screen Shot 2020-05-29 at 13 17 01

pxuab commented

Yes, the rouge score is between headlines. This function was used for experiments with one of our new ROUGE rewards, such as ROUGE score with "article". In the end, we did not use this reward but only use the sensation reward.

I understood. Thanks for your answer.