Projection-Based cascaded U-Net model for MR image reconstruction
- PMID: 34052771
- DOI: 10.1016/j.cmpb.2021.106151
Projection-Based cascaded U-Net model for MR image reconstruction
Abstract
Background and objective: Background and Objective: Recent studies in deep learning reveal that the U-Net stands out among the diverse set of deep models as an effective network structure, especially for imaging inverse problems. Initially, the U-Net model was developed to solve segmentation problems for biomedical images while using an annotated dataset. In this paper, we will study a novel application of the U-Net structure for the important inverse problem of MRI reconstruction. Deep networks are particularly efficient for the speed-up of the MR image reconstruction process by decreasing the data acquisition time, and they can significantly reduce the aliasing artifacts caused by the undersampling in the k-space. Our aim is to develop a novel and efficient cascaded U-Net framework for reconstructing MR images from undersampled k-space data. The new framework should have improved reconstruction performance when compared to competing methodologies.
Methods: In this paper, a novel cascaded framework utilizing the U-Net as a sub-block is being proposed. The introduced U-Net cascade structure is applied to the magnetic resonance image reconstruction problem. The connection between the cascaded U-Nets is realized in the form of a recently developed projection-based updated data consistency layer. The novel structure is implemented in the PyTorch environment, which is one of the standards for deep learning implementations. The recently created fastMRI dataset which forms an important benchmark for MRI reconstruction is used for training and testing purposes.
Results: We present simulation results comparing the novel method with a variety of competitive deep networks. The new cascaded U-Net structures PSNR performance stands on average 1.28 dB higher than the baseline U-Net. The improvement, when compared to the standard CNN, is on average 3.32 dB.
Conclusions: The proposed cascaded U-Net configuration results in an improved reconstruction performance when compared to the CNN, the cascaded CNN, and also the singular U-Net structures, where the singular U-Net forms the baseline reconstruction method from the fastMRI package. The use of the projection-based updated data consistency layer also leads to improved quantitative (including SSIM, PSNR, and NMSE results) and qualitative results when compared to the use of the conventional data consistency layer.
Keywords: Cascaded networks; Deep learning; Image reconstruction; Magnetic resonance imaging; U-Net; Updated data consistency.
Copyright © 2021 Elsevier B.V. All rights reserved.
Conflict of interest statement
Declaration of Competing Interest None of the authors have any conflicts to declare, financial or otherwise.
Similar articles
-
A k-space-to-image reconstruction network for MRI using recurrent neural network.Med Phys. 2021 Jan;48(1):193-203. doi: 10.1002/mp.14566. Epub 2020 Dec 12. Med Phys. 2021. PMID: 33128235
-
A cross-domain complex convolution neural network for undersampled magnetic resonance image reconstruction.Magn Reson Imaging. 2024 May;108:86-97. doi: 10.1016/j.mri.2024.02.004. Epub 2024 Feb 7. Magn Reson Imaging. 2024. PMID: 38331053
-
A cascade of preconditioned conjugate gradient networks for accelerated magnetic resonance imaging.Comput Methods Programs Biomed. 2022 Oct;225:107090. doi: 10.1016/j.cmpb.2022.107090. Epub 2022 Aug 29. Comput Methods Programs Biomed. 2022. PMID: 36067702
-
CT artifact correction for sparse and truncated projection data using generative adversarial networks.Med Phys. 2021 Feb;48(2):615-626. doi: 10.1002/mp.14504. Epub 2020 Dec 30. Med Phys. 2021. PMID: 32996149 Review.
-
Emerging Trends in Fast MRI Using Deep-Learning Reconstruction on Undersampled k-Space Data: A Systematic Review.Bioengineering (Basel). 2023 Aug 26;10(9):1012. doi: 10.3390/bioengineering10091012. Bioengineering (Basel). 2023. PMID: 37760114 Free PMC article. Review.
Cited by
-
CS-MRI Reconstruction Using an Improved GAN with Dilated Residual Networks and Channel Attention Mechanism.Sensors (Basel). 2023 Sep 6;23(18):7685. doi: 10.3390/s23187685. Sensors (Basel). 2023. PMID: 37765747 Free PMC article.
-
De-Aliasing and Accelerated Sparse Magnetic Resonance Image Reconstruction Using Fully Dense CNN with Attention Gates.Bioengineering (Basel). 2022 Dec 22;10(1):22. doi: 10.3390/bioengineering10010022. Bioengineering (Basel). 2022. PMID: 36671594 Free PMC article.
-
U-Net deep learning model for endoscopic diagnosis of chronic atrophic gastritis and operative link for gastritis assessment staging: a prospective nested case-control study.Therap Adv Gastroenterol. 2023 Nov 2;16:17562848231208669. doi: 10.1177/17562848231208669. eCollection 2023. Therap Adv Gastroenterol. 2023. PMID: 37928896 Free PMC article.
-
A Hybrid Residual Attention Convolutional Neural Network for Compressed Sensing Magnetic Resonance Image Reconstruction.Diagnostics (Basel). 2023 Mar 30;13(7):1306. doi: 10.3390/diagnostics13071306. Diagnostics (Basel). 2023. PMID: 37046524 Free PMC article.
-
A Crop Image Segmentation and Extraction Algorithm Based on Mask RCNN.Entropy (Basel). 2021 Sep 3;23(9):1160. doi: 10.3390/e23091160. Entropy (Basel). 2021. PMID: 34573785 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical
Miscellaneous