• Laser & Optoelectronics Progress
  • Vol. 57, Issue 8, 081011 (2020)
Gang Li1、*, Zhenyang Gao1, Xinchun Zhang1, Huaixin Zhao2, and Zhuo Liu3
Author Affiliations
  • 1School of Electronic and Control Engineering, Chang'an University, Xi'an, Shaanxi 710064, China
  • 2Technology Quality Department, Shaanxi Province Railway Group Co., Ltd., Xi'an, Shaanxi 710199, China
  • 3Commission for Discipline Inspection and Supervision, Xi'an Xilan Natural Gas Group Co., Ltd., Xi'an, Shaanxi 710075, China
  • show less
    DOI: 10.3788/LOP57.081011 Cite this Article Set citation alerts
    Gang Li, Zhenyang Gao, Xinchun Zhang, Huaixin Zhao, Zhuo Liu. Improved Global Convolutional Network for Pavement Crack Detection[J]. Laser & Optoelectronics Progress, 2020, 57(8): 081011 Copy Citation Text show less
    Different network models. (a) Classification model; (b) segmentation model
    Fig. 1. Different network models. (a) Classification model; (b) segmentation model
    Overall structure of the ResNet-GCN model. (a) Structure of the entire framework; (b) GCN structure; (c) boundary refinement module
    Fig. 2. Overall structure of the ResNet-GCN model. (a) Structure of the entire framework; (b) GCN structure; (c) boundary refinement module
    Dataset containing different crack types. (a) Crack; (b) watery crack; (c) crack with repair seal; (d) crack with lane line; (e) stitching seam; (f) crack containing debris
    Fig. 3. Dataset containing different crack types. (a) Crack; (b) watery crack; (c) crack with repair seal; (d) crack with lane line; (e) stitching seam; (f) crack containing debris
    Labeling of experimental crack data. (a) (b) (c) Original crack images; (d) (e) (f) manually marked cracks
    Fig. 4. Labeling of experimental crack data. (a) (b) (c) Original crack images; (d) (e) (f) manually marked cracks
    Comparision of GCN and ordinary convolution kernel
    Fig. 5. Comparision of GCN and ordinary convolution kernel
    Test accuracy of MobileNetv2-GCN model
    Fig. 6. Test accuracy of MobileNetv2-GCN model
    Test mIoU of MobileNetv2-GCN model
    Fig. 7. Test mIoU of MobileNetv2-GCN model
    Crack segmentation effect of MobileNetv2-GCN model. (a) Original images; (b) label images; (c) prediction results
    Fig. 8. Crack segmentation effect of MobileNetv2-GCN model. (a) Original images; (b) label images; (c) prediction results
    Crack skeleton extraction. (a)(b)(c) Binary images after segmentation; (d)(e)(f) extracted crack skeleton images
    Fig. 9. Crack skeleton extraction. (a)(b)(c) Binary images after segmentation; (d)(e)(f) extracted crack skeleton images
    Comparison of real and predicted average crack width pixel
    Fig. 10. Comparison of real and predicted average crack width pixel
    DataTrainingVerificationTest
    Image size /(pixel×pixel)512× 512512×512512×512
    Number of images2160720720
    Table 1. Crack dataset details
    kBase3579111315
    mIoU /%70.571.171.972.673.374.175.276.6
    Table 2. Comparison of GCN results with different convolution kernel sizes
    k357911
    mIoU /%GCN71.171.972.673.374.1
    Stack69.870.969.568.267.5
    Table 3. Comparison of GCN and equivalent small kernel stack convolution
    Number oflayersStackGCN
    204810242102048
    mIoU/%71.170.568.672.8
    Parameteramount /k75885285054307608
    Table 4. Comparison of experimental results to reduce the number of stacked convolution layers
    ModelBoundaryaccuracy /%Centeraccuracy /%Overallaccuracy /%
    Baseline71.390.170.3
    GCN71.591.185.6
    GCN+BR72.692.386.7
    Table 5. Comparison of experimental results after adding boundary refinement blocks
    ModelmIoU /%Accuracy /%Model size /MB
    ResNet- GCN76.686.7671.0
    ResNet50-GCN82.690.2274.0
    ResNet101-GCN83.693.4492.0
    MobileNetv2-GCN84.698.515.5
    Table 6. Comparison of experimental results of different pre-training fusion models
    DatasetCrack500GAPs384Cracktree200Proposed
    mIoU /%85.882.380.585.3
    Accuracy /%95.592.489.698.5
    Table 7. Experimental results of MobileNetv2-GCN on different datasets
    ModelSegNetDeepLabCNNFCNMobileNetv2-GCN
    mIoU /%67.869.272.380.585.3
    Accuracy /%74.580.381.989.698.5
    Table 8. Comparison of MobileNetv2-GCN and other crack segmentation models
    Gang Li, Zhenyang Gao, Xinchun Zhang, Huaixin Zhao, Zhuo Liu. Improved Global Convolutional Network for Pavement Crack Detection[J]. Laser & Optoelectronics Progress, 2020, 57(8): 081011
    Download Citation