🔥🔥 This is a collection of awesome articles about Implicit Neural Representation networks in medical imaging🔥🔥
📢 Our review paper published on arXiv: Implicit Neural Representation in Medical Imaging: A Comparative Survey ❤️
@article{molaei2023implicit,
title={Implicit Neural Representation in Medical Imaging: A Comparative Survey},
author={Molaei, Amirali and Aminimehr, Amirhossein and Tavakoli, Armin and Kazerouni, Amirhossein and Azad, Bobby and Azad, Reza and Merhof, Dorit},
journal={arXiv preprint arXiv:2307.16142},
year={2023}
}Implicitly representing image signals has gained popularity in recent years for a broad range of medical imaging applications. The most motivating reasons are the following:
- Memory efficiency: The amount of memory demanded to represent the signal is not restricted by the signal's resolution.
- Unlimited Resolution: They take values in the continuous domain, meaning they can generate values for coordinates in-between the pixel or voxel-wise grid
- Effective data usage: They can learn to handle reconstruction and synthesis tasks without high-cost external annotation.
Which all are significantly important for developing an automatic medical system.
With the aim of providing easier access for researchers, this repo contains a comprehensive paper list of Implicit Neural Representations in Medical Imaging, including papers, codes, and related websites.
We considered a sum of 68 research papers spanning from 2021 to 2023.
Implicit Neural Representations with Periodic Activation Functions. [17th Jun., 2020] [Advances in Neural Information Processing Systems, 2020]
Vincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell, Gordon Wetzstein.
[PDF]
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis. [19th Mar., 2020] [Communications of the ACM, 2021]
Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, Ren Ng.
[PDF]
- Image Segmentation
- Image Reconstruction
- Image Registration
- Neural Rendering
- Image Compression
- Image Synthesis
IntraTomo: Self-supervised Learning-based Tomography via Sinogram Synthesis and Prediction. [9th Feb., 2021] [Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021]
Guangming Zang, Ramzi Idoughi, Rui Li, Peter Wonka, Wolfgang Heidrich.
[PDF]
CoIL: Coordinate-based Internal Learning for Imaging Inverse Problems. [9th Feb., 2021] [IEEE Transactions on Computational Imaging, 2021]
Yu Sun, Jiaming Liu, Mingyang Xie, Brendt Wohlberg, Ulugbek S. Kamilov.
[PDF] [Github]
ImplicitVol: Sensorless 3D Ultrasound Reconstruction with Deep Implicit Representation. [24th Sep., 2021] [arXiv, 2021]
Pak-Hei Yeung, Linde Hesse, Moska Aliasi, Monique Haak, the INTERGROWTH-21st Consortium, Weidi Xie, Ana I.L. Namburete.
[PDF]
Going Off-Grid: Continuous Implicit Neural Representations for 3D Vascular Modeling. [16th Sep., 2022] [arXiv preprint, 2022]
Dieuwertje Alblas, Christoph Brune, Kak Khee Yeung, Jelmer M. Wolterink.
[PDF]
Joint Rigid Motion Correction and Sparse-View CT via Self-Calibrating Neural Field. [23th Oct., 2022] [arXiv, 2022]
Qing Wu, Xin Li, Hongjiang Wei, Jingyi Yu, Yuyao Zhang.
[PDF]
An Arbitrary Scale Super-Resolution Approach for 3-Dimensional Magnetic Resonance Image using Implicit Neural Representation. [29th Oct., 2021] [arXiv preprint, 2021]
Qing Wu, Yuwei Li, Yawen Sun, Yan Zhou, Hongjiang Wei, Jingyi Yu, Yuyao Zhang.
[PDF] [Github]
NeRP: Implicit Neural Representation Learning with Prior Embedding for Sparsely Sampled Image Reconstruction. [24th Aug., 2021] [IEEE Transactions on Neural Networks and Learning Systems, 2022]
Liyue Shen, John Pauly, Lei Xing.
[PDF] [Github]
Dynamic CT Reconstruction from Limited Views with Implicit Neural Representations and Parametric Motion Fields. [23th Apr., 2021] [Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021]
Albert W. Reed, Hyojin Kim, Rushil Anirudh, K. Aditya Mohan, Kyle Champley, Jingu Kang, Suren Jayasuriya.
[PDF]
IREM: High-Resolution Magnetic Resonance (MR) Image Reconstruction via Implicit Neural Representation. [29th Jun., 2021] [International Conference on Medical Image Computing and Computer-Assisted Intervention, 2021]
Qing Wu, Yuwei Li, Lan Xu, Ruiming Feng, Hongjiang Wei, Qing Yang, Boliang Yu, Xiaozhao Liu, Jingyi Yu, Yuyao Zhang.
[PDF]
Streak artifacts reduction algorithm using an implicit neural representation in sparse-view CT. [4th Apr., 2022] [Medical Imaging 2022: Physics of Medical Imaging, 2022]
Byeongjoon Kim, Hyunjung Shim, Jongduk Baek.
[PDF]
Representing 3D Ultrasound with Neural Fields. [21th Apr., 2022] [Medical Imaging with Deep Learning, 2022]
Ang Nan Gu, Purang Abolmaesumi, Christina Luong, Kwang Moo Yi.
[PDF]
A Memory-Efficient Dynamic Image Reconstruction Method using Neural Fields. [11th May., 2022] [arXiv, 2022]
Luke Lozenski, Mark A. Anastasio, Umberto Villa.
[PDF]
UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomography. [3th Jun., 2022] [arXiv preprint, 2022]
Francisca Vasconcelos, Bobby He, Nalini Singh, Yee Whye Teh.
[PDF]
MRI Super-Resolution using Implicit Neural Representation with Frequency Domain Enhancement. [Aug., 2022] [arXiv preprint, 2022]
Shuangming Mao, Seiichiro Kamata.
[PDF]
Dynamic Cone-beam CT Reconstruction using Spatial and Temporal Implicit Neural Representation Learning (STINR). [Sep., 2022] [Physics in Medicine and Biology, 2023]
You Zhang, Hua-Chieh Shao, Tinsu Pan, Tielige Mengke.
[PDF]
NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI. [IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022]
Junshen Xu, Daniel Moyer, Borjan Gagoski, Juan Eugenio Iglesias, P. Ellen Grant, Polina Golland,Elfar Adalsteinsson.
[PDF] [Github]
Unsupervised Polychromatic Neural Representation for CT Metal Artifact Reduction. [27th Jun., 2023] [arXiv preprint]
Qing Wu, Lixuan Chen, Ce Wang, Hongjiang Wei, S. Kevin Zhou, Jingyi Yu, Yuyao Zhang.
[PDF]
Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flow. [16th Mar., 2022] [Proceedings of the IEEE/CVF Conference on CVPR]
Shanlin Sun, Kun Han, Deying Kong, Hao Tang, Xiangyi Yan, Xiaohui Xie.
[PDF] [Github]
Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction. [31th Dec 2022] [arXiv preprint]
Jie Feng, Ruimin Feng, Qing Wu, Zhiyong Zhang, Yuyao Zhang, Hongjiang Wei.
[PDF]
Spatial Attention-based Implicit Neural Representation for Arbitrary Reduction of MRI Slice Spacing. [23th May., 2022] [arXiv preprint]
Xin Wang, Sheng Wang, Honglin Xiong, Kai Xuan, Zixu Zhuang, Mengjun Liu, Zhenrong Shen, Xiangyu Zhao, Lichi Zhang, Qian Wang.
[PDF]
Self-Supervised Coordinate Projection Network for Sparse-View Computed Tomography. [12th Sep., 2022] [IEEE Transactions on Computational Imaging, 2023]
Qing Wu, Ruimin Feng, Hongjiang Wei, Jingyi Yu, Yuyao Zhang.
[PDF] [Github]
Self-supervised arbitrary scale super-resolution framework for anisotropic MRI. [2th May., 2023] [arXiv preprint]
Haonan Zhang, Yuhan Zhang, Qing Wu, Jiangjie Wu, Zhiming Zhen, Feng Shi, Jianmin Yuan, Hongjiang Wei, Chen Liu, Yuyao Zhang.
[PDF]
OReX: Object Reconstruction from Planar Cross-sections Using Neural Fields. [23th Nov., 2022] [CVPR, 2023]
Haim Sawdayee, Amir Vaxman, Amit H. Bermano.
[PDF]
NeuRec: Incorporating Interpatient prior to Sparse-View Image Reconstruction for Neurorehabilitation. [21th Feb., 2022] [BioMed Research International, 2022]
Cong Liu, Qingbin Wang, Jing Zhang.
[PDF]
Neural Implicit k-Space for Binning-free Non-Cartesian Cardiac MR Imaging. [16th Dec., 2022] [International Conference on Information Processing in Medical Imaging, 2023]
Wenqi Huang, Hongwei Li, Jiazhen Pan, Gastao Cruz, Daniel Rueckert, Kerstin Hammernik.
[PDF]
Neural Computed Tomography. [17th Jan., 2022] [arXiv preprint, 2022]
Kunal Gupta, Brendan Colvert, Francisco Contijoch.
[PDF] [Github]
Implicitatlas: learning deformable shape templates in medical imaging. [CVPR, 2022]
Jiancheng Yang, Udaranga Wickramasinghe, Bingbing Ni, Pascal Fua.
[PDF]
ImTooth: Neural Implicit Tooth for Dental Augmented Reality. [23rd Feb., 2023] [IEEE Transactions on Visualization and Computer Graphics, 2023]
Hai Li , Hongjia Zhai , Xingrui Yang , Zhirong Wu , Jianchao Wu , Hujun Bao , Yihao Zheng , Haofan Wang , Guofeng Zhang.
[PDF]
https://www.computer.org/csdl/journal/tg/2023/05/10051634/1L03a1rPCCY
NAISR: A 3D Neural Additive Model for Interpretable Shape Representation. [16th Mar., 2023] [arXiv preprint]
Yining Jiao, Carlton Zdanski, Julia Kimbell, Andrew Prince, Cameron Worden, Samuel Kirse, Christopher Rutter, Benjamin Shields, William Dunn, Jisan Mahmud, Marc Niethammer.
[PDF] [Github]
Multi-contrast MRI Super-resolution via Implicit Neural Representations. [27th Mar., 2023] [arXiv preprint]
Julian McGinnis, Suprosanna Shit, Hongwei Bran Li, Vasiliki Sideri-Lampretsa, Robert Graf, Maik Dannecker, Jiazhen Pan, Nil Stolt Ansó, Mark Mühlau, Jan S. Kirschke, Daniel Rueckert, Benedikt Wiestler.
[PDF]
MiShape: 3D Shape Modelling of Mitochondria in Microscopy. [2nd Mar., 2023] [arXiv preprint]
Abhinanda R. Punnakkal, Suyog S Jadhav, Alexander Horsch, Krishna Agarwal, Dilip K. Prasad.
[PDF]
Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstruction. [12th Mar., 2023] [arXiv preprint]
Yiqun Lin, Zhongjin Luo, Wei Zhao, Xiaomeng Li.
[PDF] [Github]
MEPNet: A Model-Driven Equivariant Proximal Network for Joint Sparse-View Reconstruction and Metal Artifact Reduction in CT Images. [25th Jun., 2023] [arXiv preprint]
Hong Wang, Minghao Zhou, Dong Wei, Yuexiang Li, Yefeng Zheng.
[PDF] [Github]
A Novel Implicit Neural Representation for Volume Data. [27th Feb., 2023] [Applied Sciences, 2023]
Armin Sheibanifard, Hongchuan Yu.
[PDF]
A scan-specific unsupervised method for parallel MRI reconstruction via implicit neural representation. [19th Oct., 2022] [arXiv preprint]
Ruimin Feng, Qing Wu, Yuyao Zhang, Hongjiang Wei.
[PDF]
CuNeRF: Cube-Based Neural Radiance Field for Zero-Shot Medical Image Arbitrary-Scale Super Resolution. [28th Mar., 2023] [arXiv preprint]
Zixuan Chen, Jianhuang Lai, Lingxiao Yang, Xiaohua Xie.
[PDF]
Hybrid Neural Diffeomorphic Flow for Shape Representation and Generation via Triplane. [4th Jul., 2023] [arXiv preprint]
Kun Han, Shanlin Sun, Xiaohui Xie.
[PDF]
Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI. [5th Jul., 2023] [arXiv preprint]
Jiamiao Zhang, Yichen Chi, Jun Lyu, Wenming Yang, Yapeng Tian.
[PDF] [Github]
Implicit Neural Networks with Fourier-Feature Inputs for Free-breathing Cardiac MRI Reconstruction. [11th May., 2023] [arXiv preprint]
Johannes F. Kunz, Stefan Ruschke, Reinhard Heckel.
[PDF] [Github]
Implicit neural representations for unsupervised super-resolution and denoising of 4D flow MRI. [24th Feb., 2023] [arXiv preprint]
Simone Saitta, Marcello Carioni, Subhadip Mukherjee, Carola-Bibiane Schönlieb, Alberto Redaelli.
[PDF]
Hybrid-CSR: Coupling Explicit and Implicit Shape Representation for Cortical Surface Reconstruction. [23rd Jul., 2023][arXiv]
Shanlin Sun, Thanh-Tung Le, Chenyu You, Hao Tang, Kun Han, Haoyu Ma, Deying Kong, Xiangyi Yan, Xiaohui Xie.
[PDF]
NeRD: Neural Representation of Distribution for Medical Image Segmentation. [6th Mar., 2021] [arXiv preprint, 2021]
Hang Zhang, Rongguang Wang, Jinwei Zhang, Chao Li, Gufeng Yang, Pascal Spincemaille, Thanh Nguyen, Yi Wang.
[PDF]
Binary segmentation of medical images using implicit spline representations and deep learning. [19th Mar., 2021] [Computer Aided Geometric Design, 2021]
Oliver J.D. Barrowclough, Georg Muntingh, Varatharajan Nainamalai, Ivar Stangeby.
[PDF] [Github]
Implicit field learning for unsupervised anomaly detection in medical images. [9th Jun., 2021] [MICCAI 2021]
Sergio Naval Marimont, Giacomo Tarroni.
[PDF] [Github]
Implicit Neural Representations for Medical Imaging Segmentation. [16th Sep., 2022] [International Conference on Medical Image Computing and Computer-Assisted Intervention, 2022]
Muhammad Osama Khan & Yi Fang.
[PDF]
Retinal vessel segmentation based on self-distillation and implicit neural representation. [8th Nov., 2022] [Applied Intelligence, 2022]
Jia Gu, Fangzheng Tian & Il-Seok Oh.
[PDF]
Deep Implicit Statistical Shape Models for 3D Medical Image Delineation [28th Jun., 2022] [AAAI, 2022]
Ashwin Raju, Shun Miao, Dakai Jin, Le Lu, Junzhou Huang, Adam P. Harrison
[PDF] [Github]
Direct localization and delineation of human pedunculopontine nucleus based on a self-supervised magnetic resonance image super-resolution method [25 th Apr., 2023] [Human Brain Mapping, 2023]
Jun Li, Xiaojun Guan, Qing Wu, Chenyu He, Weimin Zhang, Xiyue Lin, Chunlei Liu, Hongjiang Wei, Xiaojun Xu, Yuyao Zhang
Implicit Anatomical Rendering for Medical Image Segmentation with Stochastic Experts [6th Apr., 2023] [arXiv preprint, 2023]
Chenyu You, Weicheng Dai, Yifei Min, Lawrence Staib, James S. Duncan
[PDF]
SwIPE: Efficient and Robust Medical Image Segmentation with Implicit Patch Embeddings [23rd Jul., 2023] [MICCAI 2023]
Yejia Zhang, Pengfei Gu, Nishchal Sapkota, Danny Z. Chen
[PDF]
Implicit Neural Representations for Deformable Image Registration. [22th Jun., 2022] [Medical Imaging with Deep Learning, 2022]
Jelmer M. Wolterink, Jesse C. Zwienenberg, Christoph Brune.
[PDF] [Github]
Medical Image Registration via Neural Fields. [22th Jun., 2022] [arXiv, 2022]
Shanlin Sun, Kun Han, Hao Tang, Deying Kong, Junayed Naushad, Xiangyi Yan, Xiaohui Xie.
[PDF]
Learning Homeomorphic Image Registration via Conformal-Invariant Hyperelastic Regularisation [30 th Jun., 2023 ] [arXiv preprint, 2023 ]
Jing Zou, Noémie Debroux, Lihao Liu, Jing Qin, Carola-Bibiane Schönlieb, Angelica I Aviles-Rivero
[PDF]
Diffeomorphic Image Registration with Neural Velocity Field [2023] [IEEE/CVF Winter Conference on Applications of Computer Vision, 2023]
Kun Han, Shanlin sun, Xiangyi Yan, Chenyu You, Hao Tang, Junayed Naushad, Haoyu Ma, Deying Kong, Xiaohui Xie
[PDF]
Deformable Image Registration with Geometry-informed Implicit Neural Representations [13 th Apr., 2023] [Medical Imaging with Deep Learning, 2023]
Louis van Harten, Rudolf Leonardus Mirjam Van Herten, Jaap Stoker, Ivana Isgum
[PDF]
Implicit neural representations for joint decomposition and registration of gene expression images in the marmoset brain. [8th Aug., 2023] [arxiv preprint]
Michal Byra, Charissa Poon, Tomomi Shimogori, Henrik Skibbe
[PDF]
MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-ray. [2nd Feb., 2022] [IEEE EMBC, 2022]
Abril Corona-Figueroa, Jonathan Frawley, Sam Bond-Taylor, Sarath Bethapudi, Hubert P. H. Shum, Chris G. Willcocks.
[PDF] [Github]
Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgery. [30th Jun., 2022] [MICCAI, 2022]
Yuehao Wang, Yonghao Long, Siu Hin Fan, Qi Dou.
[PDF] [Github]
NAF: Neural Attenuation Fields for Sparse-View CBCT Reconstruction. [29th Sep., 2022] [ MICCAI, 2022]
Ruyi Zha, Yanhao Zhang, Hongdong Li.
[PDF] [Github]
SNAF: Sparse-view CBCT Reconstruction with Neural Attenuation Fields. [30th Nov., 2022] [ arXiv preprint, 2022]
Yu Fang, Lanzhuju Mei, Changjian Li, Yuan Liu, Wenping Wang, Zhiming Cui, Dinggang Shen.
[PDF]
Ultra-NeRF: Neural Radiance Fields for Ultrasound Imaging. [25th Jan., 2023] [MIDL, 2023]
Magdalena Wysocki, Mohammad Farid Azampour, Christine Eilers, Benjamin Busam, Mehrdad Salehi, Nassir Navab.
[PDF]
3D reconstructions of brain from MRI scans using neural radiance fields. [24th Apr., 2023] [Preprint, 2023]
Khadija Iddrisu, Sylwia Malec, Alessandro Crimi.
[PDF]
SCI: A Spectrum Concentrated Implicit Neural Compression for Biomedical Data. [23th Nov., 2022] [AAAI, 2023]
Runzhao Yang, Tingxiong Xiao, Yuxiao Cheng, Qianni Cao, Jinyuan Qu, Jinli Suo, Qionghai Dai.
[PDF] [Github]
TINC: Tree-structured Implicit Neural Compression. [12th Nov., 2022] [arXiv, 2022]
Runzhao Yang, Tingxiong Xiao, Yuxiao Cheng, Jinli Suo, Qionghai Dai.
[PDF] [Github]
COIN++ Neural Compression Across Modalities [8th Dec ., 2022] [arXiv preprint, 2022]
Emilien Dupont, Hrushikesh Loya, Milad Alizadeh, Adam Goliński, Yee Whye Teh, Arnaud Doucet
[PDF]
SINCO: A Novel structural regularizer for image compression using implicit neural representations [5th May., 2023] [IEEE International Conference on Acoustics, Speech and Signal Processing, 2023]
Harry Gao, Weijie Gan, Zhixin Sun, Ulugbek S. Kamilov
[PDF]
Implicit Neural Representations for Generative Modeling of Living Cell Shapes. [6th Oct., 2022] [International Conference on Medical Image Computing and Computer-Assisted Intervention, 2022]
David Wiesner, Julian Suk, Sven Dummer, David Svoboda, Jelmer M. Wolterink.
[PDF]
Generative modeling of living cells with SO(3)-equivariant implicit neural representations. [18 th Apr., 2023] [arXiv preprint, 2023]
David Wiesner, Julian Suk, Sven Dummer, Tereza Nečasová, Vladimír Ulman, David Svoboda, Jelmer M. Wolterink
[PDF]