Evaluation data from table 1

Question

Evaluation data from table 1

BloodLemonS opened this issue 9 months ago · 5 comments

How to obtain evaluation data for table 1? The values obtained when testing the DAVIS data of the release model using the provided evaluation.py file differ significantly from those in the paper.

Answer 1 · 2024-02-13T15:02:58.000Z

Just follow our instructions to perform the evaluation.
You may need to check the installed requirements.

Answer 2 · 2024-02-18T02:57:11.000Z

I have checked the installation requirements and found that installing different versions of third-party libraries due to differences in device hardware configuration may result in significant calculation errors?

Answer 3 · 2024-02-23T04:52:28.000Z

We have tested on both 3090 and V100, and the metrics are consistent. Could you please tell me whether you used our mask for evaluation?

Answer 4 · 2024-02-23T06:31:59.000Z

Yes, we conducted the test on the 3070 graphics card using 50 provided test datasets. Except for one dataset with an inf test result, the average PSNR of the other datasets was around 20

Answer 5 · 2024-02-23T06:45:01.000Z

This is very weird. Please carefully check whether the environment configuration is the same as ours. The difference in GPU will not lead to different results.