denotation accuracy or LF accuracy
zhuang-li opened this issue · 0 comments
zhuang-li commented
Hi Cao,
Thank you for your wonderful work. I am curious that whether the accuracy you reported with overnight dataset is denotation-based or LF-based. As I tested your code but only got 0.5476 in the calendar domain if I use LF-based metric. But I have not tried denotation-based metric as there are some issues with my java environment. I'd really appreciate if you could clarify this point for me.
BTW. I also see you compared your work with seq2act. Did they use denotation-based or LF-based? I can't find any reference in their paper and their code is quite messy.
Best
Zhuang