What does the MV and SV mean in the training and testing process?
Closed this issue · 2 comments
RongkunYang commented
What does the MV and SV mean in the training and testing process?
xuxw98 commented
SV means single-view. SV models are trained on independent RGB-D frames. MV means multi-view. MV (or Online) models are trained on RGB-D sequence for online perception.
To train an online perception model, we first train it on SV data. Then we insert memory-based adapters into the model and finetune it on MV data. The auxiliary tasks, such as bounding box prediction and query contrast, are only included in the second training stage.
You can refer to our previous paper for a more detailed discussion. Online3D,CVPR24
RongkunYang commented
OK, thank you for your enthusiastic response. I will dive into this wonderful work.
Best wishes!