Real-Time Semantic Segmentation Based on Dilated Convolution Smoothing and Lightweight Up-Sampling

Cheng Xiaoyue; Zhao Longzhang; Hu Qiong; Shi Jiapeng

doi:10.3788/LOP57.021017

[1] Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 3431-3440(2015).

[2] Zhao H S, Shi J P, Qi X J et al. Pyramid scene parsing network. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 6230-6239(2017).

[3] Chen L C, Papandreou G, Kokkinos I, fully connected CRFs[J/OL] et al. -06-07)[2019-05-30]. https:∥arxiv., org/abs/1412, 7062(2016).

[4] Chen L C, Papandreou G, Kokkinos I et al. DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 834-848(2018).

[5] Lin G S, Milan A, Shen C H et al. RefineNet: multi-path refinement networks for high-resolution semantic segmentation. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 5168-5177(2017).

[6] Zhang X Y, Zhou X Y, Lin M X et al. ShuffleNet: an extremely efficient convolutional neural network for mobile devices. [C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE, 6848-6856(2018).

[7] Huang G, Liu S C, van der Maaten L et al. -06-07)[2019-05-30]. https:∥arxiv., org/abs/1711, 09224(2018).

[8] Sifre L. -03-07)[2019-05-30]. https:∥arxiv., org/abs/1403, 1687(2014).

[9] Wang M, Liu B, Foroosh H. Factorized convolutional neural networks. [C]∥Proceedings of the IEEE International Conference on Computer Vision, October 22-29, 2017, Venice, Italy. New York: IEEE, 545-553(2017).

[10] Zhao H S, Qi X J, Shen X Y et al. -08-20)[2019-05-30]. https:∥arxiv., org/abs/1704, 08545(2018).

[11] Romera E, Alvarez J M, Bergasa L M et al. ERFNet: efficient residual factorized ConvNet for real-time semantic segmentation[J]. IEEE Transactions on Intelligent Transportation Systems, 19, 263-272(2018).

[12] Paszke A, Chaurasia A, Kim S et al. -06-07)[2019-05-30]. https:∥arxiv., org/abs/1606, 02147(2016).

[13] Yu C Q, Wang J B, Peng C et al. Learning a discriminative feature network for semantic segmentation. [C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE, 1857-1866(2018).

[14] Hu M Y, Zhang Y Z, Qin C et al. Semantic map construction based on deep convolutional neural network[J]. ROBOT, 41, 452-463(2019).

[15] Badrinarayanan V, Kendall A, Cipolla R. SegNet: a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 2481-2495(2017).

[16] Wu C Y, Yi B S, Zhang Y G et al. Retinal vessel image segmentation based on improved convolutional neural network[J]. Acta Optica Sinica, 38, 1111004(2018).

[17] Li S M, Lei G Q, Fan R. Depth map super-resolution based on two-channel convolutional neural network[J]. Acta Optica Sinica, 38, 1010002(2018).

[18] Gao L, Song W D, Tan H et al. Cloud detection based on multi-scale dilation convolutional neural network for ZY-3 satellite remote sensing imagery[J]. Acta Optica Sinica, 39, 0104002(2019).

[19] Wang P Q, Chen P F, Yuan Y et al. Understanding convolution for semantic segmentation. [C]∥2018 IEEE Winter Conference on Applications of Computer Vision (WACV), March 12-15, 2018, Lake Tahoe, NV, USA. New York: IEEE, 1451-1460(2018).

[20] Wang Z Y, Ji S W. Smoothed dilated convolutions for improved dense prediction. [C]∥Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining - KDD '18, August 19-23, 2018, London, United Kingdom. New York: ACM, 2486-2495(2018).

[21] Liu Y F, Chen K, Liu C et al. -03-12)[2019-05-30]. https:∥arxiv., org/abs/1903, 04197(2019).

[22] Huang T H, Nie Z Y, Wang Q G, Li S, Yan L C, Guo D S[2019-04-15]. Image real-time semantic segmentation based on block adaptive feature fusion Acta Automatica Sinica:1-12[2019-04-15]..

[23] Yu F. -04-30)[2019-05-30]. https:∥arxiv., org/abs/1511, 07122(2016).

[24] Ziegler T, Fritsche M, Kuhn L et al. -03-19)[2019-05-30]. https:∥arxiv., org/abs/1903, 07992(2019).

[25] Bai J, Hao P H, Chen S H. Traffic scene understanding using image semantic segmentation with an improved lightweight convolutional-neural-network[J]. Journal of Automotive Safety and Energy, 9, 433-440(2018).

[26] Jaderberg M, Simonyan K, Zisserman A et al. -02-04)[2019-05-30]. https:∥arxiv., org/abs/1506, 02025(2016).

[28] Farabet C, Couprie C, Najman L et al. Learning hierarchical features for scene labeling[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1915-1929(2013).

[29] Rasmus A, Berglund M, Honkala M et al. Semi-supervised learning with ladder networks. [C]∥Advances in Neural Information Processing Systems, December 7-12, 2015, Montreal, Quebec, Canada. Canada: NIPS, 3546-3554(2015).

[30] Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation[M]. ∥Navab N, Hornegger J, Wells W, et al. Medical image computing and computer-assisted intervention-MICCAI 2015. Lecture notes in computer science. Cham: Springer, 9351, 234-241(2015).

[31] Orši M, Krešo I, Bevandi P et al. -04-12) https:∥arxiv.org/abs/1903.08469?context=cs[2019-05-30]. CV.(2019).

[32] Lu W C, Pang Y W, He Y Q et al. Real-time and accurate semantic segmentation based on separable residual modules[J]. Laser & Optoelectronics Progress, 56, 051005(2019).

[33] Hinton G, Vinyals O. -03-09)[2019-05-30]. https:∥arxiv., org/abs/1503, 02531(2015).

[34] Kullback S, Leibler R A. On information and sufficiency[J]. The Annals of Mathematical Statistics, 22, 79-86(1951).

[35] Gulrajani I, Ahmed F, Arjovsky M et al. Improved training of Wasserstein GANs. [C]∥Advances in Neural Information Processing Systems, December 4-9, 2017, Long Beach, CA, USA. Canada: NIPS, 5767-5777(2017).

[36] Zhang H, Goodfellow I, Metaxas D et al. -06-14)[2019-06-30]. https:∥arxiv., org/abs/1805, 08318(2019).

[37] Zhao H, Zhang Y, Liu S et al. Psanet: point-wise spatial attention network for scene parsing. [C]∥Proceedings of the European Conference on Computer Vision (ECCV), September 8-14, 2018, Munich, Germany. New York: IEEE, 267-283(2018).

[38] Cordts M, Omran M, Ramos S et al. The cityscapes dataset for semantic urban scene understanding. [C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June 26-July 1, 2016, Las Vegas, Nevada. New York: IEEE, 3213-3223(2016).

[39] Brostow G J, Shotton J, Fauqueur J et al. Segmentation and recognition using structure from motion point clouds[M]. ∥Forsyth D, Torr P, Zisserman A. Computer vision-ECCV 2008. Lecture notes in computer science. Berlin, Heidelberg: Springer, 5302, 44-57(2008).