LayoutPrompter evaluation code?
conan1024hao opened this issue · 1 comments
conan1024hao commented
Hi, thank you for sharing LayoutPrompter's code! It's really an amazing work.
Do you have a plan to public the evaluation part code or share some implementation details? Such as do you only use the top result for calculate alignment, overlap... or average the 10 output results?
kaoshizhou commented
Thanks for paying attention to our work! In the experimental results except Table 8, we calculate metrics on the top-1 layouts of the layout ranker. In Table 8, we use all 10 outputs to calculate the means and variances of the metrics to show the stability of the performance.
We use the evaluation code of baseline works for fair comparison. Specifically,