The aim of our project is to apply deep learning techniques in the field of optical imaging to images taken from mobile microscope. We consider data that consists of z-stack images of specimen (more details in dataset description). In this work we would like to use the next techniques:
- In-focus/out-of-focus images classification. When automatically scanning specimen, it is necessary to choose only in-focus images. In comparison to classical focus measure operators DL techniques allow not to lose small focused parts of the image.
- Fast scanning image deblurring. Obtaining of the high quality images requires much more time while scanning. The idea is to reuse DL deblurring techniques for fast scanning when we can reconstruct original image from one obtained from fast movement.
- Focus-stacking (Multi-Focus fusion). Because of the main feature of optical microscopes is shallow depth of focus, therefore volume specimen can not be studied from one focal length -- user should change it mechanically to understand the structure of sample. The idea is to apply all-in-focus technique to construct the image where all the parts are sharp.
The code was written by:
- Egor Sevriugov and Kirill Shcherbakov - Focus stacking for volume specimens
- Maria Begicheva and Olga Novitskaya - Deblurring and denoising
- Mikhail Salnikov and Anastasiia Kornilova - In-focus/out-of-focus images filtering
MMDF: Project | Report | Presentation | Video report
- Python 3
- Google Colaboratory service
- PyTorch 1.4.0, Tensorflow 2.1.0, Keras 2.3.0
The dataset contains the videos of z-stack scanning recorded by a smartphone microscope (150 specimen). Every scan is presented in 4 videos with different speed of scanning.
- "DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks": Paper | Code
- "IFCNN: A General Image Fusion Framework Based on Convolutional Neural Network, Information Fusion, 54 (2020) 99-118": Paper | Code
- "FFusionCGAN: An end-to-end fusion method for few-focus images using conditional GAN in cytopathological digital slides": Paper | Code
- "Assessing microscope image focus quality with deep learning. BMC Bioinformatics 19, 77 (2018)." Paper | Code