Image Semantic Segmentation Based on Multi-Scale Feature Extraction and Fully Connected Conditional Random Fields

Yongfeng Dong; Yuxin Yang; Liqin Wang

doi:10.3788/LOP56.131007

[1] Guo Y M, Liu Y, Georgiou T et al. A review of semantic segmentation using deep neural networks[J]. International Journal of Multimedia Information Retrieval, 7, 87-93(2018). http://link.springer.com/article/10.1007/s13735-017-0141-z

[2] Guo C C, Yu F Q, Chen Y. Image semantic segmentation based on Convolutional neural network feature and improved superpixel matching[J]. Laser & Optoelectronics Progress, 55, 081005(2018).

[3] Wei Y C, Zhao Y. A review on image semantic segmentation based on DCNN[J]. Journal of Beijing Jiaotong University, 40, 82-91(2016).

[4] Zhang X M, Zhu X B, Cai Q et al. Survey of the deep learning models for image semantic segmentation[J]. Chinese High Technology Letters, 27, 808-815(2017).

[5] Rother C, Kolmogorov V, Blake A. GrabCut: interactive foreground extraction using iterated graph cuts[J]. ACM Transactions on Graphics, 23, 309-314(2004). http://dl.acm.org/citation.cfm?id=1186562.1015720

[6] Long J, Shelhamer E, Darrell T. Fully Convolutional networks for semantic segmentation. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 3431-3440(2015).

[7] Chen L C, Papandreou G, Kokkinos I, fully connected CRFs[EB/OL] et al. -06-07)[2018-10-25]. https:∥arxiv., org/abs/1412, 7062(2016).

[8] Badrinarayanan V, Kendall A, Cipolla R. SegNet: a deep Convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 2481-2495(2017). http://ieeexplore.ieee.org/document/7803544/

[9] Noh H, Hong S, Han B. Learning deConvolution network for semantic segmentation. [C]∥2015 IEEE International Conference on Computer Vision (ICCV), December 7-13, 2015, Santiago, Chile. New York: IEEE, 1520-1528(2015).

[10] Yu F. -04-30)[2018-10-25]. https:∥arxiv., org/abs/1511, 07122(2016).

[11] Chen L C, Papandreou G, Kokkinos I et al. DeepLab: semantic image segmentation with deep Convolutional nets, atrous Convolution, and fully connected CRFs[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 834-848(2018). http://www.ncbi.nlm.nih.gov/pubmed/28463186

[12] Zhao H S, Shi J P, Qi X J et al. Pyramid scene parsing network. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 6230-6239(2017).

[13] Lin G S. Shen C H, van den Hengel A, et al. Efficient piecewise training of deep structured models for semantic segmentation. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 3194-3203(2016).

[14] Xiong Z Y, Zhang G F, Wang J Q. Multi-scale feature extract for image sematic segmentation[J]. Journal of South-Central University for Nationalities(Natural Science Edition), 36, 118-124(2017).

[15] Jiang Y F, Zhang H, Xue Y B et al. A new multi-scale image semantic understanding method based on deep learning[J]. Journal of Optoelectronics·Laser, 27, 224-230(2016).

[16] Liu D, Liu X J, Wang M Z. Semantic segmentation with multi-scale Convolutional neural network[J]. Remote Sensing Information, 32, 57-64(2017).

[17] Zheng S, Jayasumana S, Romera-Paredes B et al. Conditional random fields as recurrent neural networks. [C]∥2015 IEEE International Conference on Computer Vision (ICCV), December 7-13, 2015, Santiago, Chile. New York: IEEE, 1529-1537(2015).

[18] Lin G S. Shen C H, van den Hengel A, et al. Exploring context with deep structured models for semantic segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 1352-1366(2018).

[19] Lafferty J D. McCallum A, Pereira F C N. Conditional random fields: probabilistic models for segmenting and labeling sequence data. [C]∥Proceedings of the Eighteenth International Conference on Machine Learning, June 28-July 01, 2001. San Francisco: Morgan Kaufmann Publishers Inc., 282-289(2001).

[20] Krähenbühl P, Koltun V. Efficient inference in fully connected CRFs with Gaussian edge potentials. [C]∥Proceedings of the 24th International Conference on Neural Information Processing Systems, December 12-15, 2011, Granada, Spain. USA: Curran Associates Inc., 109-117(2011).

[21] Vemulapalli R, Tuzel O, Liu M Y et al. Gaussian conditional random field network for semantic segmentation. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA, 3224-3233(2016).

[22] Hazirbas C, Ma L N, Domokos C et al. FuseNet: incorporating depth into semantic segmentation via fusion-based CNN architecture[M]. ∥Lai S H, Lepetit V, Nishino K, et al.Computer vision-ACCV 2016. Lecture notes in computer science. Cham: Springer, 10111, 213-228(2017).

[23] Silberman N, Hoiem D, Kohli P et al. Indoor segmentation and support inference from RGBD images[M]. ∥Fitzgibbon A, Lazebnik S, Perona P, et al. Computer vision-ECCV 2012. Lecture notes in computer science. Berlin, Heidelberg: Springer, 7576, 746-760(2012).

[24] Gupta S, Arbeláez P, Malik J. Perceptual organization and recognition of indoor scenes from RGB-D images. [C]∥2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 23-28, 2013, Portland, OR, USA. New York: IEEE, 564-571(2013).

[25] Gupta S, Girshick R, Arbeláez P et al. Learning rich features from RGB-D images for object detection and segmentation[M]. ∥ Fleet D, Pajdla T, Schiele B, et al. Computer vision-ECCV 2014. Lecture notes in computer science. Cham: Springer, 8695, 345-360(2014).

[26] Deng Z, Todorovic S, Latecki L J. Semantic segmentation of RGBD images with mutex constraints. [C]∥2015 IEEE International Conference on Computer Vision (ICCV), December 7-13, 2015, Santiago, Chile. New York: IEEE, 1733-1741(2015).