LVOSV2 test server

Question

LVOSV2 test server

Closed this issue 4 months ago · 8 comments

How can I test the LVOSV2 test set?

Answer 1 · 2024-05-09T04:00:07.000Z

Hello, thanks for your interest. We haven't had the plan to release the LVOS V2 test server. We will release the code for evaluation of valid set within this week. For the LVOS V2 test set, we will keep it for the challenge purpose. You can evaluate the ability of your model by using the validation set.
Feel free to contact me or raise the issue if you have any question.

Bests,
Lingyi

Answer 2 · 2024-05-09T04:57:54.000Z

Thanks! Could the evaluation code of v1 be used to validate the v2?

Answer 3 · 2024-05-09T05:05:54.000Z

Indeed, the evaluation code for v2 is similar to that of v1 for semi-supervised vos. However, due to the unseen video list is loaded through txt file, if you don't have the txt file for v2, you can not evaluate your model correctly. Besides, we also optimize the code to speed up the evaluation process.

Bests,
Lingyi

Answer 4 · 2024-05-09T05:09:24.000Z

Looking forward to it!
Best,
MDS

Answer 5 · 2024-05-09T05:11:39.000Z

By the way, when will you release the code of Onetracker? I am also interested~

Answer 6 · 2024-05-09T05:27:30.000Z

Sry, we don't have the plan to release the code of OneTracker. The code of OneTracker is extremely simple. I think you can reproduce it based on ViPT easily. If you have any question about OneTracker, feel free to contact me through email, and you can find my email from my homepage or the paper of OneTracker. Thanks for your interest on our works!

Answer 7 · 2024-05-10T06:13:45.000Z

Hi, we have released the evaluation code for LVOS V2, and you can find it at here. You can set the lvos_path to switch the evaluation for v1 or v2. Please see this repo for more details.
If you have any question, feel free to let me know.

Best regards,
Lingyi

Answer 8 · 2024-05-20T03:52:48.000Z

I will close it for now. Feel free to open it in case of future questions!