/HFDAEP

Deep Frequency-recurrent Priors for Inverse Imaging Reconstruction

Primary LanguageMATLAB

HFDAEP

The Code is created based on the method described in the following paper:
Zhuonan He, Kai Hong, Jinjie Zhou, Dong Liang, Yuhao Wang, Qiegen Liu.
Deep Frequency-Recurrent Priors for Inverse Imaging Reconstruction.
Signal Processing, Volume 190, January 2022, 108320.
https://www.sciencedirect.com/science/article/pii/S0165168421003571

Motivation

Ill-posed inverse problems in imaging remain an active research topic in several decades,with new approaches constantly emerging. Recognizing that the popular dictionary learning and convolutional sparse coding are both essentially modeling the high-frequency component of an image, which convey most of the semantic infor-mation such as texture details, in this work we propose a novel multi-profile high-frequency transform-guided denoising autoencoder for attainting deep frequency-recurrent prior (DFRP). To achieve this goal, we first extract a set of multi-profile high-frequency components via a specific transformation and add artificial Gaussian noise to these high-frequency components as training samples. As the high-frequency prior information is learned, we incorporate it into classical iterative reconstruction by proximal gradient descent. Preliminary results on highly under-sampled magnetic resonance imag-ing and sparse-view computed tomography reconstruction demonstrate that the proposed method can efficiently reconstruct feature details and present advantages over state-of-the-arts.

version

In order to effectively use the high-frequency prior information to reconstruct the texture details of the image, we designed two different schemes. Here we call them HFDAEP_v1 and HFDAEP_v2.

In this paper, we use the image decomposition and component summation to approximate the forward and inverse transformations.

repeat-HFDAEPRec Fig. 1. Demonstration of (a) the forward transform operator and (b) the backward transform operator in HF-DAEP.

repeat-HFDAEPRec Fig. 2. Illustration of HF-DAEP at iterative reconstruction phase. Here MRI reconstruction is visualized.

HFDAEP_v1

Table

repeat-HFDAEPRec

Visual Comparisons

repeat-HFDAEPRec Fig. 3. Visual comparisons under 2D Random sampling at 80%. Top line: reference image, reconstruction using DLMRI, PANO and FDLCP; Bottom line: reconstruction using NLR-CS, DC-CNN, EDAEP and HFDAEP.

MRI reconstruction

'./HFDAEP_v1/DemoMRI/demo_MRI.m' is the demo of HF-DAEP_v1 for MRI reconstruction.

CT reconstruction

'./HFDAEP_v1/DemoCT/demo_CTRec.m' is the demo of HF-DAEP_v1 for CT reconstruction. './HFDAEP_v1/DemoCT/ultilies/generateSystemMatrix.m' is used to generate the system matrix.

HFDAEP_v2

Table

repeat-HFDAEPRec

Visual Comparisons

repeat-HFDAEPRec Fig. 4. Visual comparisons under 2D Random sampling at 80%. Top line: reference image, reconstruction using DLMRI, PANO and FDLCP; Bottom line: reconstruction using NLR-CS, DC-CNN, EDAEP and DFRP.

MRI reconstruction

'./HFDAEP_v2/DemoMRI/demo_MRI_DFPR.m' is the demo of HF-DAEP_v2 for MRI reconstruction.

CT reconstruction

'./HFDAEP_v2/DemoCT/demo_CTRec.m' is the demo of HF-DAEP_v2 for CT reconstruction.

Requirements and Dependencies

matlab
caffe
cuda 8.0
@article{he2019learning, 
title={Learning Priors in High-frequency Domain for Inverse Imaging Reconstruction},
author={He, Zhuonan and Zhou, Jinjie and Liang, Dong and Wang, Yuhao and Liu, Qiegen},
journal={arXiv preprint arXiv:1910.11148},
year={2019}
}

Other Related Projects