Improved U-Net Models and Its Applications in Medical Image Segmentation: A Review

Huan Zhang; Dawei Qiu; Yibo Feng; Jing Liu

doi:10.3788/LOP202259.0200005

[1] LeCun Y, Bengio Y, Hinton G. Deep learning[J]. Nature, 521, 436-444(2015).

[2] Li S, Tso G K F, He K J. Bottleneck feature supervised U-Net for pixel-wise liver and tumor segmentation[J]. Expert Systems With Applications, 145, 113131(2020).

[3] Zhou F Y, Jin L P, Dong J. Review of convolutional neural network[J]. Chinese Journal of Computers, 40, 1229-1251(2017).

[4] Feng Y B, Qiu D W, Cao H et al. Research on coronavirus disease 2019 (COVID-19) detection method based on depthwise separable DenseNet in chest X-ray images[J]. Journal of Biomedical Engineering, 37, 557-565(2020).

[5] Shelhamer E, Long J, Darrell T. Fully convolutional networks for semantic segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 640-651(2017).

[6] Ronneberger O, Fischer P, Brox T. U-net: convolutional networks for biomedical image segmentation[M]. Navab N, Hornegger J, Wells W M, et al. Medical image computing and computer-assisted intervention-MICCAI 2015. Lecture notes in computer science, 9351, 234-241(2015).

[7] Xiang J H, Xu H. Research on image semantic segmentation algorithm based on deep learning[J]. Application Research of Computers, 37, 316-317, 320(2020).

[8] Zhang J W, Jin Y Z, Xu J L et al. MDU-Net: multi-scale densely connected U-Net for biomedical image segmentation[EB/OL]. https:∥arxiv.org/abs/1812.00352

[9] Ibtehaz N, Rahman M S. MultiResUNet: rethinking the U-Net architecture for multimodal biomedical image segmentation[J]. Neural Networks, 121, 74-87(2020).

[10] Oktay O, Schlemper J, le Folgoc L et al. Attention U-Net: learning where to look for the pancreas[EB/OL]. https:∥arxiv.org/abs/1804.03999

[11] Jin Q G, Meng Z P, Pham T D et al. DUNet: a deformable network for retinal vessel segmentation[J]. Knowledge-Based Systems, 178, 149-162(2019).

[12] Chen C, Liu X P, Ding M et al. 3D dilated multi-fiber network for real-time brain tumor segmentation in MRI[M]. Shen D G, Liu T M, Peters T M, et al. Medical image computing and computer assisted intervention-MICCAI 2019. Lecture notes in computer science, 11766, 184-192(2019).

[13] Alom M Z, Hasan M, Yakopcic C et al. Recurrent residual convolutional neural network based on U-Net (R2U-Net) for medical image segmentation[EB/OL]. https:∥arxiv.org/abs/1802.06955

[14] Chen W L, Zhang Y, He J J et al. Prostate segmentation using 2D bridged U-Net[C], 1-7(2019).

[15] Fu H Z, Cheng J, Xu Y W et al. Joint optic disc and cup segmentation based on multi-label deep network and polar transformation[J]. IEEE Transactions on Medical Imaging, 37, 1597-1605(2018).

[16] Milletari F, Navab N, Ahmadi S A. V-net: fully convolutional neural networks for volumetric medical image segmentation[C], 565-571(2016).

[17] Guan S, Khan A A, Sikdar S et al. Fully dense UNet for 2-D sparse photoacoustic tomography artifact removal[J]. IEEE Journal of Biomedical and Health Informatics, 24, 568-576(2020).

[18] Dolz J, Ayed I B, Desrosiers C. Dense multi-path U-net for ischemic stroke lesion segmentation in multiple image modalities[M]. Crimi A, Bakas S, Kuijf H, et al. Brainlesion: glioma, multiple sclerosis, stroke and traumatic brain injuries. Lecture notes in computer science, 11383, 271-282(2019).

[19] Zhang Z A, Wu C D, Coleman S et al. DENSE-INception U-net for medical image segmentation[J]. Computer Methods and Programs in Biomedicine, 192, 105395(2020).

[20] Hu J, Shen L, Albanie S et al. Squeeze-and-excitation networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 2011-2023(2020).

[21] Zhu W T, Huang Y F, Zeng L et al. AnatomyNet: deep learning for fast and fully automated whole-volume segmentation of head and neck anatomy[J]. Medical Physics, 46, 576-589(2019).

[22] He C E, Xu H J, Wang Z et al. Automatic segmentation algorithm for multimodal magnetic resonance-based brain tumor images[J]. Acta Optica Sinica, 40, 0610001(2020).

[23] Zhuang J T. LadderNet: multi-path networks based on U-Net for medical image segmentation[EB/OL]. https:∥arxiv.org/abs/1810.07810

[24] Wang W J, Chen J X, Zhao J et al. Automated segmentation of pulmonary lobes using coordination-guided deep neural networks[C], 1353-1357(2019).

[25] Dubost F, Bortsova G, Adams H et al. GP-Unet: lesion detection from weak labels with a 3D regression network[M]. Descoteaux M, Maier-Hein L, Franz A, et al. Medical image computing and computer assisted intervention-MICCAI 2017. Lecture notes in computer science, 10435, 214-221(2017).

[26] Zhou Z W, Rahman Siddiquee M M, Tajbakhsh N et al. UNet++: a nested U-net architecture for medical image segmentation[M]. Stoyanov D, Taylor Z, Carneiro G, et al. Deep learning in medical image analysis and multimodal learning for clinical decision support. Lecture notes in computer science, 11045, 3-11(2018).

[27] Huang H M, Lin L F, Tong R F et al. UNet 3+: a full-scale connected UNet for medical image segmentation[C], 1055-1059(2020).

[28] Jin Q G, Meng Z P, Sun C M et al. RA-UNet: a hybrid deep attention-aware network to extract liver and tumor in CT scans[J]. Frontiers in Bioengineering and Biotechnology, 8, 605132(2020).

[29] Li C, Tan Y S, Chen W et al. ANU-Net: attention-based nested U-Net to exploit full resolution features for medical image segmentation[J]. Computers & Graphics, 90, 11-20(2020).

[30] Li M, Dong S Z, Gao Z F et al. Unified model for interpreting multi-view echocardiographic sequences without temporal information[J]. Applied Soft Computing, 88, 106049(2020).

[31] Keetha N V, Babu P S A, Annavarapu C S R. U-Det: a modified U-Net architecture with bidirectional feature network for lung nodule segmentation[EB/OL]. https:∥arxiv.org/abs/2003.09293

[32] Jha D, Riegler M A, Johansen D et al. DoubleU-Net: a deep convolutional neural network for medical image segmentation[C], 558-564(2020).

[33] Valloli V K, Mehta K. W-Net: reinforced u-net for density map estimation[EB/OL]. https:∥arxiv.org/abs/1903.11249

[34] Zhang X D, Wang T J, Zhu S J et al. Hyperspectral image classification based on dilated convolutional attention neural network[J]. Acta Optica Sinica, 41, 0310001(2021).

[35] Tian F Y, Zhou M Q, Yan F et al. Spinal CT segmentation based on AttentionNet and DenseUnet[J]. Laser & Optoelectronics Progress, 57, 201008(2020).

[36] Isensee F, Petersen J, Klein A et al. nnU-net: self-adapting framework for U-net-based medical image segmentation[EB/OL]. https:∥arxiv.org/abs/1809.10486

[37] Çiçek Ö, Abdulkadir A, Lienkamp S S et al. 3D U-Net: learning dense volumetric segmentation from sparse annotation[M]. Ourselin S, Joskowicz L, Sabuncu M R, et al. Medical image computing and computer-assisted intervention-MICCAI 2016, 9901, 424-432(2016).

[38] Wu Y X, He K M. Group normalization[J]. International Journal of Computer Vision, 128, 742-755(2020).

[39] Huang Y J, Shi Z F, Wang Z Q et al. Improved U-net based on mixed loss function for liver medical image segmentation[J]. Laser & Optoelectronics Progress, 57, 221003(2020).

[40] Mou H W, Guo Y, Quan X H et al. Magnetic resonance imaging brain tumor image segmentation based on improved U-Net[J]. Laser & Optoelectronics Progress, 58, 0410022(2021).

[41] Zhu C Z, Zou B J, Xiang Y et al. A survey of retinal vessel segmentation in fundus images[J]. Journal of Computer-Aided Design & Computer Graphics, 27, 2046-2057(2015).

[42] Tian F, Li Y, Wang J. Retinal blood vessel segmentation based on multi-scale wavelet transform fusion[J]. Acta Optica Sinica, 41, 0410001(2021).

[43] Abràmoff M D, Garvin M K, Sonka M. Retinal imaging and image analysis[J]. IEEE Reviews in Biomedical Engineering, 3, 169-208(2010).

[44] Li R R, Li M M, Li J C et al. Connection sensitive Attention U-Net for accurate retinal vessel segmentation[EB/OL]. https:∥arxiv.org/abs/1903.05558

[45] Li D X, Zhang Z. Improved U-net segmentation algorithm for the retinal blood vessel images[J]. Acta Optica Sinica, 40, 1010001(2020).

[46] Zhong S H, Guo X M, Zheng Y N. Improved U-net network for lung nodule segmentation[J]. Computer Engineering and Applications, 56, 203-209(2020).

[47] Zhang P, Xu X N, Wang H W et al. Computer-aided lung cancer diagnosis approaches based on deep learning[J]. Journal of Computer-Aided Design & Computer Graphics, 30, 90-99(2018).

[48] Gao X, Bi X J. Detection of low dose CT pulmonary nodules based on improved Faster R-CNN[J]. Application Research of Computers, 37, 404-406, 409(2020).

[49] Hou T X, Zhao J J, Qiang Y et al. Pulmonary nodules segmentation based on CRF 3D-UNet structure[J]. Computer Engineering and Design, 41, 1663-1669(2020).

[50] Zhang Q W, Chen M, Qin Y F et al. Lung nodule segmentation based on 3D ResUNet network[J]. Chinese Journal of Medical Physics, 36, 1356-1361(2019).

[51] Zhong S H, Wang M L, Guo X M et al. Study on the improved VNet network based pulmonary nodule segmentation method[J]. Chinese Journal of Scientific Instrument, 41, 206-215(2020).

[52] Wang P, Qiang Y, Yang X T et al. Network model for lung nodule segmentation based on double attention 3D-UNet[J]. Computer Engineering, 47, 307-313(2021).

[53] Sun M J, Xu J, Ma W et al. A new fully convolutional network for 3D liver region segmentation on CT images[J]. Chinese Journal of Biomedical Engineering, 37, 385-393(2018).

[54] Lei T, Zhou W Z, Zhang Y X et al. Lightweight V-Net for liver segmentation[C], 1379-1383(2020).

[55] Jiang Z K, Lü X G, Zhang J X et al. Review of deep learning methods for MRI brain tumor image segmentation[J]. Journal of Image and Graphics, 25, 215-228(2020).

[56] Li Q, Bai K X, Zhao L et al. Progresss and challenges of MRI brain tumor image segmentation[J]. Journal of Image and Graphics, 25, 419-431(2020).

[57] Lai X B, Xu M S, Xu X M. Glioblastoma multiforme multi-modal MR images segmentation using multi-class CNN[J]. Acta Electronica Sinica, 47, 1738-1747(2019).

[58] Dong H, Yang G, Liu F D et al. Automatic brain tumor detection and segmentation using U-net based fully convolutional networks[M]. Hernández M V, González-Castro V. Medical image understanding and analysis. Communications in computer and information science, 723, 506-517(2017).

[59] Feng X, Tustison N J, Patel S H et al. Brain tumor segmentation using an ensemble of 3D U-Nets and overall survival prediction using radiomic features[J]. Frontiers in Computational Neuroscience, 14, 25(2020).