/MedicalNet

Many studies have shown that the performance on deep learning is significantly affected by volume of training data. The MedicalNet project provides a series of 3D-ResNet pre-trained models and relative code.

Primary LanguagePythonOtherNOASSERTION

MedicalNet

This repository contains a Pytorch implementation of Med3D: Transfer Learning for 3D Medical Image Analysis. Many studies have shown that the performance on deep learning is significantly affected by volume of training data. The MedicalNet project aggregated the dataset with diverse modalities, target organs, and pathologies to to build relatively large datasets. Based on this dataset, a series of 3D-ResNet pre-trained models and corresponding transfer-learning training code are provided.

License

MedicalNet is released under the MIT License (refer to the LICENSE file for detailso).

Citing MedicalNet

If you use this code or pre-trained models, please cite the following:

    @article{chen2019med3d,
        title={Med3D: Transfer Learning for 3D Medical Image Analysis},
        author={Chen, Sihong and Ma, Kai and Zheng, Yefeng},
        journal={arXiv preprint arXiv:1904.00625},
        year={2019}
    }

Update(2019/07/30)

We uploaded 4 pre-trained models based on more datasets (23 datasets).

Model name             : parameters settings
resnet_10_23dataset.pth: --model resnet --model_depth 10 --resnet_shortcut B
resnet_18_23dataset.pth: --model resnet --model_depth 18 --resnet_shortcut A
resnet_34_23dataset.pth: --model resnet --model_depth 34 --resnet_shortcut A
resnet_50_23dataset.pth: --model resnet --model_depth 50 --resnet_shortcut B

We transferred the above pre-trained models to the multi-class segmentation task (left lung, right lung and background) on Visceral dataset. The results are as follows:

Network Pretrain LungSeg(Dice)
3D-ResNet10 Train from scratch 69.31%
MedicalNet 96.56%
3D-ResNet18 Train from scratch 70.89%
MedicalNet 94.68%
3D-ResNet34 Train from scratch 75.25%
MedicalNet 94.14%
3D-ResNet50 Train from scratch 52.94%
MedicalNet 89.25%

Contents

  1. Requirements
  2. Installation
  3. Demo
  4. Experiments
  5. TODO
  6. Acknowledgement

Requirements

  • Python 3.7.0
  • PyTorch-0.4.1
  • CUDA Version 9.0
  • CUDNN 7.0.5

Installation

  • Install Python 3.7.0
  • pip install -r requirements.txt

Demo

  • Structure of data directories
MedicalNet is used to transfer the pre-trained model to other datasets (here the MRBrainS18 dataset is used as an example).
MedicalNet/
    |--datasets/:Data preprocessing module
    |   |--brains18.py:MRBrainS18 data preprocessing script
    |	|--models/:Model construction module
    |   |--resnet.py:3D-ResNet network build script
    |--utils/:tools
    |   |--logger.py:Logging script
    |--toy_data/:For CI test
    |--data/:Data storage module
    |   |--MRBrainS18/:MRBrainS18 dataset
    |	|   |--images/:source image named with patient ID
    |	|   |--labels/:mask named with patient ID
    |   |--train.txt: training data lists
    |   |--val.txt: validation data lists
    |--pretrain/:Pre-trained models storage module
    |--model.py: Network processing script
    |--setting.py: Parameter setting script
    |--train.py: MRBrainS18 training demo script
    |--test.py: MRBrainS18 testing demo script
    |--requirement.txt: Dependent library list
    |--README.md
  • Network structure parameter settings
Model name   : parameters settings
resnet_10.pth: --model resnet --model_depth 10 --resnet_shortcut B
resnet_18.pth: --model resnet --model_depth 18 --resnet_shortcut A
resnet_34.pth: --model resnet --model_depth 34 --resnet_shortcut A
resnet_50.pth: --model resnet --model_depth 50 --resnet_shortcut B
resnet_101.pth: --model resnet --model_depth 101 --resnet_shortcut B
resnet_152.pth: --model resnet --model_depth 152 --resnet_shortcut B
resnet_200.pth: --model resnet --model_depth 200 --resnet_shortcut B
  • After successfully completing basic installation, you'll be ready to run the demo.
  1. Clone the MedicalNet repository
git clone https://github.com/Tencent/MedicalNet
  1. Download data & pre-trained models (Google Drive or Tencent Weiyun)

    Unzip and move files

mv MedicalNet_pytorch_files.zip MedicalNet/.
cd MedicalNet
unzip MedicalNet_pytorch_files.zip
  1. Run the training code (e.g. 3D-ResNet-50)
python train.py --gpu_id 0 1    # multi-gpu training on gpu 0,1
or
python train.py --gpu_id 0    # single-gpu training on gpu 0
  1. Run the testing code (e.g. 3D-ResNet-50)
python test.py --gpu_id 0 --resume_path trails/models/resnet_50_epoch_110_batch_0.pth.tar --img_list data/val.txt

Experiments

  • Computational Cost
GPU:NVIDIA Tesla P40
Network Paramerers (M) Running time (s)
3D-ResNet10 14.36 0.18
3D-ResNet18 32.99 0.19
3D-ResNet34 63.31 0.22
3D-ResNet50 46.21 0.21
3D-ResNet101 85.31 0.29
3D-ResNet152 117.51 0.34
3D-ResNet200 126.74 0.45
  • Performance
Visualization of the segmentation results of our approach vs. the comparison ones after the same training epochs. 
It has demonstrated that the efficiency for training convergence and accuracy based on our MedicalNet pre-trained models.

Results of transfer MedicalNet pre-trained models to lung segmentation (LungSeg) and pulmonary nodule classification (NoduleCls) with Dice and accuracy evaluation metrics, respectively.
Network Pretrain LungSeg(Dice) NoduleCls(accuracy)
3D-ResNet10 Train from scratch 71.30% 79.80%
MedicalNet 87.16% 86.87%
3D-ResNet18 Train from scratch 75.22% 80.80%
MedicalNet 87.26% 88.89%
3D-ResNet34 Train from scratch 76.82% 83.84%
MedicalNet 89.31% 89.90%
3D-ResNet50 Train from scratch 71.75% 84.85%
MedicalNet 93.31% 89.90%
3D-ResNet101 Train from scratch 72.10% 81.82%
MedicalNet 92.79% 90.91%
3D-ResNet152 Train from scratch 73.29% 73.74%
MedicalNet 92.33% 90.91%
3D-ResNet200 Train from scratch 71.29% 76.77%
MedicalNet 92.06% 90.91%

TODO

  • 3D-ResNet series pre-trained models
  • Transfer learning training code
  • Training with multi-gpu
  • 3D efficient pre-trained models(e.g., 3D-MobileNet, 3D-ShuffleNet)
  • 2D medical pre-trained models
  • Pre-trained MedicalNet models based on more medical dataset

Acknowledgement

We thank 3D-ResNets-PyTorch and MRBrainS18 which we build MedicalNet refer to this releasing code and the dataset.

Contribution

If you want to contribute to MedicalNet, be sure to review the contribution guidelines.