• Laser & Optoelectronics Progress
  • Vol. 57, Issue 2, 21017 (2020)
Cheng Xiaoyue, Zhao Longzhang, Hu Qiong, and Shi Jiapeng
Author Affiliations
  • College of Electrical Engineering and Control Science, Nanjing Tech University, Nanjing, Jiangsu 211816, China
  • show less
    DOI: 10.3788/LOP57.021017 Cite this Article Set citation alerts
    Cheng Xiaoyue, Zhao Longzhang, Hu Qiong, Shi Jiapeng. Real-Time Semantic Segmentation Based on Dilated Convolution Smoothing and Lightweight Up-Sampling[J]. Laser & Optoelectronics Progress, 2020, 57(2): 21017 Copy Citation Text show less
    Different convolution types. (a) Ordinary convolution; (b) dilated convolution; (c) dilated convolution after smoothing
    Fig. 1. Different convolution types. (a) Ordinary convolution; (b) dilated convolution; (c) dilated convolution after smoothing
    Dilated convolution and smoothing effect[24]. (a) Dilated convolution; (b) dilated convolution after smoothing
    Fig. 2. Dilated convolution and smoothing effect[24]. (a) Dilated convolution; (b) dilated convolution after smoothing
    Structure of residual unit in convolution block
    Fig. 3. Structure of residual unit in convolution block
    Structural diagram of network with HC-LUM
    Fig. 4. Structural diagram of network with HC-LUM
    Comparison of segmentation accuracy between proposed segmentation method and other methods for 19 types of objects
    Fig. 5. Comparison of segmentation accuracy between proposed segmentation method and other methods for 19 types of objects
    Influence of knowledge distillation method on accuracy of each segmentation network
    Fig. 6. Influence of knowledge distillation method on accuracy of each segmentation network
    Comparison of segmentation accuracy for different network layers
    Fig. 7. Comparison of segmentation accuracy for different network layers
    Segmentation results of proposed method. (a) Original images 1; (b) segmentation results of original images 1 (including enlarged images of partial detail); (c) original images 2; (d) segmentation results of original images 2
    Fig. 8. Segmentation results of proposed method. (a) Original images 1; (b) segmentation results of original images 1 (including enlarged images of partial detail); (c) original images 2; (d) segmentation results of original images 2
    MethodMIOU /%Frame rate /(frame·s-1)Parameter /107
    ResNeXt-18+D-Cov72.336.31.25
    ResNeXt-18+DCSM73.736.11.39
    ResNeXt-18+DCSM+HC-LUM73.935.91.18
    Proposed76.840.21.18
    Table 1. Corresponding results of four segmentation methods on Cityscapes dataset
    MethodMIOU /%Frame rate /(frame·s-1)
    ResNeXt-18+D-Cov64.233.9
    ResNeXt-18+DCSM64.733.7
    ResNeXt-18+DCSM+HC-LUM65.132.5
    Proposed65.334.2
    Table 2. Corresponding results of four segmentation methods on CamVid dataset
    MethodMIOU /%Frame rate /(frame·s-1)
    ICNet69.530.3
    Two-column Net72.914.7
    LadderDenseNet72.8231.0
    ESPNet60.3112
    ERFNet68.011.2
    GUNet70.437.3
    Proposed76.840.2
    Table 3. Comparison of proposed method with other segmentation networks (Cityscapes dataset)
    MethodMIOU /%Frame rate /(frame·s-1)
    ICNet67.127.8
    PSPNet69.15.4
    Dilation1065.34.4
    SegNet46.44.6
    ERFNet59.410.1
    GUNet61.831.3
    Proposed65.334.2
    Table 4. Comparison of proposed method with other segmentation networks (CamVid dataset)
    Cheng Xiaoyue, Zhao Longzhang, Hu Qiong, Shi Jiapeng. Real-Time Semantic Segmentation Based on Dilated Convolution Smoothing and Lightweight Up-Sampling[J]. Laser & Optoelectronics Progress, 2020, 57(2): 21017
    Download Citation