Med-Imagetools: Transparent and Reproducible Medical Image Processing Pipelines in Python
Med-Imagetools, a python package offers the perfect tool to transform messy medical dataset folders to deep learning ready format in few lines of code. It not only processes DICOMs consisting of different modalities (like CT, PET, RTDOSE and RTSTRUCTS), it also transforms them into deep learning ready subject based format taking the dependencies of these modalities into consideration.
Introduction
A medical dataset, typically contains multiple different types of scans for a single patient in a single study. As seen in the figure below, the different scans containing DICOM of different modalities are interdependent on each other. For making effective machine learning models, one ought to take different modalities into account.
Fig.1 - Different network topology for different studies of different patientsMed-Imagetools is a unique tool, which focuses on subject based Machine learning. It crawls the dataset and makes a network by connecting different modalities present in the dataset. Based on the user defined modalities, med-imagetools, queries the graph and process the queried raw DICOMS. The processed DICOMS are saved as nrrds, which med-imagetools converts to torchio subject dataset and eventually torch dataloader for ML pipeline.
Fig.2 - Med-Imagetools start to end pipelineInstalling med-imagetools
pip install med-imagetools
(recommended) Create new conda virtual environment
conda create -n mit
conda activate mit
pip install med-imagetools
(optional) Install in development mode
conda create -n mit
conda activate mit
pip install -e git+https://github.com/bhklab/med-imagetools.git
This will install the package in editable mode, so that the installed package will update when the code is changed.
Demo
These google collab notebooks will introduce the main functionalities of med-imagetools. More information can be found here
Tutorial 1: Forming Dataset with med-imagetools Autopipeline
Tutorial 2: Machine Learning with med-imagetools and torchio
Getting Started
Med-Imagetools takes two step approch to turn messy medical raw dataset to ML ready dataset.
- Autopipeline: Crawls the raw dataset, forms a network and performs graph query, based on the user defined modalities. The relevant DICOMS, get processed and saved as nrrds
python imgtools/autopipeline.py\ [INPUT DIRECTORY] \ [OUTPUT DIRECTORY] \ --modalities [str: CT,RTSTRUCT,PT] \ --spacing [Tuple: (int,int,int)]\ --n_jobs [int]\ --visualize [bool: True/False]\
- class Dataset: This class converts processed nrrds to torchio subjects, which can be easily converted to torch dataset
from imgtools.io import Dataset subjects = Dataset.load_from_nrrd(output_directory, ignore_multi=True) data_set = tio.SubjectsDataset(subjects) data_loader = torch.utils.data.DataLoader(data_set, batch_size=4, shuffle=True, num_workers=4)
Contributors
Thanks to the following people who have contributed to this project:
Contact
If you have any questions/concerns, you can reach the following contributors at sejin.kim@uhnresearch.ca
License
This project uses the following license: Apache License 2.0