WangYueFt/detr3d

Training diverge for different setting

bronyayang opened this issue · 0 comments

Hi,

I was trying to test for different image encoder backbones.

The config file I am using was detr3d_res101_gridmask.py (https://github.com/WangYueFt/detr3d/blob/main/projects/configs/detr3d/detr3d_res101_gridmask.py).

I only change load_from='ckpts/fcos3d.pth' to load_from = None, then the model diverges.
I change image backbone from ResNet 101 to 50 (pretrained using torchvision or detectron2 caffe) all diverges.

Do I have to use the exact given setting or did I do something wrong? How to change image encoder backbones or train it from scratch?