• Laser & Optoelectronics Progress
  • Vol. 57, Issue 14, 141004 (2020)
Xingping Shi1、2, Jiangtao Xu1、2, Yongtang Jiang1、2, Shuzhen Qin1、2、*, and Kaige Lu1、2
Author Affiliations
  • 1School of Microelectronics, Tianjin University, Tianjin 300072, China
  • 2Tianjin Key Laboratory of Imaging and Sensing Microelectronic Technology, Tianjin 300072, China
  • show less
    DOI: 10.3788/LOP57.141004 Cite this Article Set citation alerts
    Xingping Shi, Jiangtao Xu, Yongtang Jiang, Shuzhen Qin, Kaige Lu. A Neural Network for Multi-Spectral Semantic Segmentation Based on LBP Feature Enhancement[J]. Laser & Optoelectronics Progress, 2020, 57(14): 141004 Copy Citation Text show less
    Calculation diagram of LBP
    Fig. 1. Calculation diagram of LBP
    Effect diagram of LBP algorithm. (a) Original image; (b) LBP feature image
    Fig. 2. Effect diagram of LBP algorithm. (a) Original image; (b) LBP feature image
    LBP calculation method in neural network
    Fig. 3. LBP calculation method in neural network
    Structure of LBP feature enhancement neural network
    Fig. 4. Structure of LBP feature enhancement neural network
    Schematic diagram of the LBPplus algorithm
    Fig. 5. Schematic diagram of the LBPplus algorithm
    Some visual results of the testset from RGB-Thermal dataset
    Fig. 6. Some visual results of the testset from RGB-Thermal dataset
    More visual results in detail
    Fig. 7. More visual results in detail
    CategoryRTFNet50 (Acc/IoU)MFNet (Acc/IoU)FuseNet (Acc/IoU)LBP34 (Acc/IoU)
    Average50.3/43.541.1/36.551.6/47.160.7/51.9
    Car91.1/84.372.9/60.976.8/73.789.7/83.2
    Person76.4/66.160.2/53.467.7/62.474.2/65.7
    Bike67.4/55.854.4/43.1365.6/54.572.3/59.4
    Curve60.1/42.426.3/22.948.5/4057.6/41.5
    Car stop38.7/30.111.9/9.4319.6/17.631.3/25.1
    Guardrail1.1/0.60/00/016.4/4.0
    Color cone4.11/3.1120.3/18.841.8/34.350.9/45.9
    Bump14.5/11.425.2/23.545.2/43.754.6/44.3
    Table 1. Test results on RGB-Thermal dataset%
    CategoryDay(Acc/IoU)Night(Acc/IoU)
    RTFNet5049.3/41.747.4/41.6
    MFNet42.6/36.141.4/36.8
    FuseNet50.7/44.247.5/44.6
    LBP3455.2/45.857.4/50.7
    Table 2. Test results on day and night images of RGB-Thermal dataset
    Xingping Shi, Jiangtao Xu, Yongtang Jiang, Shuzhen Qin, Kaige Lu. A Neural Network for Multi-Spectral Semantic Segmentation Based on LBP Feature Enhancement[J]. Laser & Optoelectronics Progress, 2020, 57(14): 141004
    Download Citation