The results can not be reproduced

Question

The results can not be reproduced

Opened this issue 3 years ago · 4 comments

The results in your paper about WEBNLG on bleu-4 is 61，while I re-run your code, I only get 46. Can you provide a pretrained model or release your evaluation code.

Thanks

Answer 1 · 2021-09-26T09:37:53.000Z

We have uploaded the evaluation code.

Answer 2 · 2021-09-27T01:28:53.000Z

Thank you, however，as I used your evaluation code. The results are as follows

Is there any error in dataset?

Answer 3 · 2021-09-29T13:03:14.000Z

We have fixed the error.

Answer 4 · 2021-09-29T13:25:20.000Z

We have fixed the error.

However, the results still can not be reproduced. Is there any pretrained model？