MedicalNet
This repository contains a Pytorch implementation of Med3D: Transfer Learning for 3D Medical Image Analysis. Many studies have shown that the performance on deep learning is significantly affected by volume of training data. The MedicalNet project aggregated the dataset with diverse modalities, target organs, and pathologies to to build relatively large datasets. Based on this dataset, a series of 3D-ResNet pre-trained models and corresponding transfer-learning training code are provided.
License
MedicalNet is released under the MIT License (refer to the LICENSE file for detailso).
Citing MedicalNet
If you use this code or pre-trained models, please cite the following:
@article{chen2019med3d,
title={Med3D: Transfer Learning for 3D Medical Image Analysis},
author={Chen, Sihong and Ma, Kai and Zheng, Yefeng},
journal={arXiv preprint arXiv:1904.00625},
year={2019}
}
Update(2019/07/30)
We uploaded 4 pre-trained models based on more datasets (23 datasets).
Model name : parameters settings
resnet_10_23dataset.pth: --model resnet --model_depth 10 --resnet_shortcut B
resnet_18_23dataset.pth: --model resnet --model_depth 18 --resnet_shortcut A
resnet_34_23dataset.pth: --model resnet --model_depth 34 --resnet_shortcut A
resnet_50_23dataset.pth: --model resnet --model_depth 50 --resnet_shortcut B
We transferred the above pre-trained models to the multi-class segmentation task (left lung, right lung and background) on Visceral dataset. The results are as follows:
Network
Pretrain
LungSeg(Dice)
3D-ResNet10
Train from scratch
69.31%
MedicalNet
96.56%
3D-ResNet18
Train from scratch
70.89%
MedicalNet
94.68%
3D-ResNet34
Train from scratch
75.25%
MedicalNet
94.14%
3D-ResNet50
Train from scratch
52.94%
MedicalNet
89.25%
Contents
Requirements
- Python 3.7.0
- PyTorch-0.4.1
- CUDA Version 9.0
- CUDNN 7.0.5
Installation
- Install Python 3.7.0
- pip install -r requirements.txt
Demo
- Structure of data directories
MedicalNet is used to transfer the pre-trained model to other datasets (here the MRBrainS18 dataset is used as an example).
MedicalNet/
|--datasets/：Data preprocessing module
| |--brains18.py：MRBrainS18 data preprocessing script
| |--models/：Model construction module
| |--resnet.py：3D-ResNet network build script
|--utils/：tools
| |--logger.py：Logging script
|--toy_data/：For CI test
|--data/：Data storage module
| |--MRBrainS18/：MRBrainS18 dataset
| | |--images/：source image named with patient ID
| | |--labels/：mask named with patient ID
| |--train.txt: training data lists
| |--val.txt: validation data lists
|--pretrain/：Pre-trained models storage module
|--model.py: Network processing script
|--setting.py: Parameter setting script
|--train.py: MRBrainS18 training demo script
|--test.py: MRBrainS18 testing demo script
|--requirement.txt: Dependent library list
|--README.md
- Network structure parameter settings
Model name : parameters settings
resnet_10.pth: --model resnet --model_depth 10 --resnet_shortcut B
resnet_18.pth: --model resnet --model_depth 18 --resnet_shortcut A
resnet_34.pth: --model resnet --model_depth 34 --resnet_shortcut A
resnet_50.pth: --model resnet --model_depth 50 --resnet_shortcut B
resnet_101.pth: --model resnet --model_depth 101 --resnet_shortcut B
resnet_152.pth: --model resnet --model_depth 152 --resnet_shortcut B
resnet_200.pth: --model resnet --model_depth 200 --resnet_shortcut B
- After successfully completing basic installation, you'll be ready to run the demo.
- Clone the MedicalNet repository
git clone https://github.com/Tencent/MedicalNet
-
Download data & pre-trained models (Google Drive or Tencent Weiyun)
Unzip and move files
mv MedicalNet_pytorch_files.zip MedicalNet/.
cd MedicalNet
unzip MedicalNet_pytorch_files.zip
- Run the training code (e.g. 3D-ResNet-50)
python train.py --gpu_id 0 1 # multi-gpu training on gpu 0,1
or
python train.py --gpu_id 0 # single-gpu training on gpu 0
- Run the testing code (e.g. 3D-ResNet-50)
python test.py --gpu_id 0 --resume_path trails/models/resnet_50_epoch_110_batch_0.pth.tar --img_list data/val.txt
Experiments
- Computational Cost
GPU：NVIDIA Tesla P40
Network
Paramerers (M)
Running time (s)
3D-ResNet10
14.36
0.18
3D-ResNet18
32.99
0.19
3D-ResNet34
63.31
0.22
3D-ResNet50
46.21
0.21
3D-ResNet101
85.31
0.29
3D-ResNet152
117.51
0.34
3D-ResNet200
126.74
0.45
- Performance
Visualization of the segmentation results of our approach vs. the comparison ones after the same training epochs.
It has demonstrated that the efficiency for training convergence and accuracy based on our MedicalNet pre-trained models.
Results of transfer MedicalNet pre-trained models to lung segmentation (LungSeg) and pulmonary nodule classification (NoduleCls) with Dice and accuracy evaluation metrics, respectively.
Network
Pretrain
LungSeg(Dice)
NoduleCls(accuracy)
3D-ResNet10
Train from scratch
71.30%
79.80%
MedicalNet
87.16%
86.87%
3D-ResNet18
Train from scratch
75.22%
80.80%
MedicalNet
87.26%
88.89%
3D-ResNet34
Train from scratch
76.82%
83.84%
MedicalNet
89.31%
89.90%
3D-ResNet50
Train from scratch
71.75%
84.85%
MedicalNet
93.31%
89.90%
3D-ResNet101
Train from scratch
72.10%
81.82%
MedicalNet
92.79%
90.91%
3D-ResNet152
Train from scratch
73.29%
73.74%
MedicalNet
92.33%
90.91%
3D-ResNet200
Train from scratch
71.29%
76.77%
MedicalNet
92.06%
90.91%
- Please refer to Med3D: Transfer Learning for 3D Medical Image Analysis for more details：
TODO
- [x] 3D-ResNet series pre-trained models
- [x] Transfer learning training code
- [x] Training with multi-gpu
- [ ] 3D efficient pre-trained models（e.g., 3D-MobileNet, 3D-ShuffleNet）
- [ ] 2D medical pre-trained models
- [x] Pre-trained MedicalNet models based on more medical dataset
Acknowledgement
We thank 3D-ResNets-PyTorch and MRBrainS18 which we build MedicalNet refer to this releasing code and the dataset.
Contribution
If you want to contribute to MedicalNet, be sure to review the contribution guidelines