Project-MONAI/research-contributions

Questions regarding accelerating training speed

yl3639 opened this issue · 0 comments

yl3639 commented

Hi may I ask how can I speed up the training?

my input image size is (96, 96, 96) and batch size can only be set to 2, training one epoch would take 12 hours.

my training command is:
python main.py --json_list dataset_01.json --feature_size=48 --noamp --use_checkpoint --batch_size 2 --max_epochs=5000 --save_checkpoint --logdir lumen --use_normal_dataset --resume_ckpt --pretrained_model_name model.pt

Thanks you so much for reply