davisvideochallenge/davis2017-evaluation

semi-supervised evaluation

Closed this issue · 2 comments

fatemehazimi990 commented

Hi,

For semi-supervised evaluation, it seems that the last frame is excluded link.
The reason for excluding the first frame is clear, but I would appreciate it if you explain the reason for excluding the last frame.
Thank you!

scaelles commented

Hello!

The last frame is excluded for historical reasons. In the DAVIS 2016 paper, some approaches that were benchmarked did not produce a result for the last frame and therefore it was excluded. In order to keep evaluations compatible, we decided not to change it in the following iterations of the DAVIS datasets.

  • 👍2
fatemehazimi990 commented

Thank you for the clarification!

  • 👍1