gpu cost duing training

[JunMa11]

Thanks for sharing the awesome work!

I have a minor question.

how many GPU hours does the model training process need on the COCO and ADE20K datasets?

[MaureenZOU]

That depends on whether you are doing the pretraining and finetuning, for finetuning:

COCO: 16 V100 gpus ~ 50h
ADE: 16 V100 gpus ~ 8h

[JunMa11]

Hi @MaureenZOU,

thanks for your quick reply very much.

How long does it take for pre-training?

[jwyang]

For a tiny model, it takes around 3-4 days with 32gpus to pre-train on COCO + VL data.