• Laser & Optoelectronics Progress
  • Vol. 58, Issue 14, 1410025 (2021)
Hui Luo, Chen Jia*, and Jian Li
Author Affiliations
  • School of Information Engineering, East China JiaoTong University, Nanchang, Jiangxi 330013, China
  • show less
    DOI: 10.3788/LOP202158.1410025 Cite this Article Set citation alerts
    Hui Luo, Chen Jia, Jian Li. Road Surface Disease Detection Algorithm Based on Improved YOLOv4[J]. Laser & Optoelectronics Progress, 2021, 58(14): 1410025 Copy Citation Text show less
    Network structure of YOLOv4
    Fig. 1. Network structure of YOLOv4
    Schematic diagram of CSPResNet. (a) Resblock_body; (b) CSPResNet(X)t
    Fig. 2. Schematic diagram of CSPResNet. (a) Resblock_body; (b) CSPResNet(X)t
    Standard convolution process
    Fig. 3. Standard convolution process
    Depth separable convolution process
    Fig. 4. Depth separable convolution process
    Standard convolution and depth separable convolution model based on YOLOv4 network structure. (a) Standard convolution model; (b) depth separate convolution model
    Fig. 5. Standard convolution and depth separable convolution model based on YOLOv4 network structure. (a) Standard convolution model; (b) depth separate convolution model
    Examples of data set and label for road surface disease. (a) Examples of data set for road surface disease; (b) examples of label for road surface disease
    Fig. 6. Examples of data set and label for road surface disease. (a) Examples of data set for road surface disease; (b) examples of label for road surface disease
    Examples of road surface disease data augmenting
    Fig. 7. Examples of road surface disease data augmenting
    Changes of training losses based on improved YOLOv4
    Fig. 8. Changes of training losses based on improved YOLOv4
    Comparison of P-R curves for road surface disease based on different network models
    Fig. 9. Comparison of P-R curves for road surface disease based on different network models
    Detection results of road surface disease based on different network models. (a) Input images; (b) Faster R-CNN; (c) SSD; (d) YOLOv3; (e) YOLOv4; (f) YOLOv4+DC; (g) YOLOv4+FL; (h) YOLOv4+DC+FL
    Fig. 10. Detection results of road surface disease based on different network models. (a) Input images; (b) Faster R-CNN; (c) SSD; (d) YOLOv3; (e) YOLOv4; (f) YOLOv4+DC; (g) YOLOv4+FL; (h) YOLOv4+DC+FL
    Name of sampleMethod
    FlipCropBrightAdd noise
    tran_cr--
    long_cr--
    mesh_cr
    pothole
    Table 1. Data augmenting methods of different road surface disease types
    Name of sampleTraning samplesValidation samplesTest samplesTotal
    tran_cr17762222222220
    long_cr15521941941940
    mesh_cr7929999990
    pothole5006262624
    Total46205775775774
    Table 2. Sample distribution of road surface disease data
    Name of modelEvaluation index /%
    mAPAP (tran_cr)AP (long_cr)AP (mesh_cr)AP (pothole)Time /ms
    Faster R-CNN93.5596.2996.4191.5489.96105.0
    SSD82.4486.0287.8388.0767.8144.3
    YOLOv384.1891.4487.3588.2669.6939.5
    YOLOv490.3993.2493.1488.4986.6743.7
    YOLOv4+DC91.0193.2693.6589.1887.9535.6
    YOLOv4+FL92.2295.9694.6790.0588.1843.8
    YOLOv4+DC+FL93.6496.3796.3891.7790.0435.8
    Table 3. Comparison of detection results of road surface disease based on different network models
    Hui Luo, Chen Jia, Jian Li. Road Surface Disease Detection Algorithm Based on Improved YOLOv4[J]. Laser & Optoelectronics Progress, 2021, 58(14): 1410025
    Download Citation