• Acta Photonica Sinica
  • Vol. 50, Issue 1, 188 (2021)
Ying ZHU1 and Ming ZHAO1、2
Author Affiliations
  • 1College of Information Engineering, Shanghai Maritime University, Shanghai20306,China
  • 2Key Laboratory of Intelligent Infrared Perception, Chinese Academy of Sciences, Shanghai00083, China
  • show less
    DOI: 10.3788/gzxb20215001.0110002 Cite this Article
    Ying ZHU, Ming ZHAO. Registration of Laser Point Cloud and Optical Image in Urban Area Based on Semantic Segmentation[J]. Acta Photonica Sinica, 2021, 50(1): 188 Copy Citation Text show less
    Flow diagram
    Fig. 1. Flow diagram
    Construction of Unet
    Fig. 2. Construction of Unet
    The segmentation results of UNET model for different kind image
    Fig. 3. The segmentation results of UNET model for different kind image
    The outline of buildings(blue) and the minimum enclosing rectangle(red) from the segmentation result
    Fig. 4. The outline of buildings(blue) and the minimum enclosing rectangle(red) from the segmentation result
    Find the pairs of matched points
    Fig. 5. Find the pairs of matched points
    The depth image
    Fig. 6. The depth image
    The first comparative experiment of optical image segmentation results between traditional segmentation method and deep learning method
    Fig. 7. The first comparative experiment of optical image segmentation results between traditional segmentation method and deep learning method
    The second comparative experiment of optical image segmentation results between traditional segmentation method and deep learning method
    Fig. 8. The second comparative experiment of optical image segmentation results between traditional segmentation method and deep learning method
    The first group of comparative experiments of point cloud segmentation results between traditional segmentation method and deep learning method
    Fig. 9. The first group of comparative experiments of point cloud segmentation results between traditional segmentation method and deep learning method
    The second group of comparative experiments of point cloud segmentation results between traditional segmentation method and deep learning method
    Fig. 10. The second group of comparative experiments of point cloud segmentation results between traditional segmentation method and deep learning method
    The first group of test data
    Fig. 11. The first group of test data
    The second group of test data
    Fig. 12. The second group of test data
    The third group of test data
    Fig. 13. The third group of test data
    Point matching result
    Fig. 14. Point matching result
    Registration result
    Fig. 15. Registration result
    Intermediate process diagram of the Method II
    Fig. 16. Intermediate process diagram of the Method II
    DataSegment methodSDRSFNRSACC
    The first optical imageUnet94.93%11.22%84.76%
    Meanshift clustering segmentation85.06%14.19%74.58%
    Maximum entropy threshold segmentation85.56%8.53%79.24%
    The second optical imageUnet99.65%11.82%87.91%
    Meanshift clustering segmentation78.71%34.17%55.88%
    Maximum entropy threshold segmentation80.46%6.08%76.48%
    The first point cloudUnet95.67%10.74%86.80%
    Meanshift clustering segmentation25.19%49.53%20.20%
    Maximum entropy threshold segmentation22.29%56.72%17.25%
    The second point cloudUnet99.60%14.62%85.08%
    Meanshift clustering segmentation20.28%3.91%20.11%
    Maximum entropy threshold segmentation22.29%56.72%17.25%
    Table 1. Segmentation index data
    DataMin errorMax errorAverage error

    The first group

    of test data

    a1.414.472.85
    b2.235.383.05
    c2.235.833.51
    d1.003.612.14
    e1.003.002.27

    The second group

    of test data

    a2.236.064.05
    b4.475.004.73
    c2.003.602.88
    d1.074.242.76
    e1.415.653.51

    The third group

    of test data

    a1.244.002.71
    b2.002.822.47
    c2.005.093.27
    d2.236.083.98
    e1.004.002.39
    Table 2. Registration accuracy(uint:pixel)
    DataMethod IMethod IIMethod IIIOur method
    EMatch pointsCorrect matchEMatch pointsCorrect matchEMatch pointsCorrect matchE
    a-19.8392/40/553.16
    a-210.21182/744.08443.93
    a-38.14202/50/333.75
    a-410.18251/51/552.78
    a-515.071832.6552/442.38
    b-174.79190/60/444.55
    b-2191.55170/52/554.74
    b-3191.28130/60/552.95
    b-488.64130/61/553.34
    b-5138.46120/41/553.51
    c-1115.18141/41/442.94
    c-2154.13260/62/442.49
    c-3124.37170/60/333.42
    c-4107.5590/744.41444.30
    c-5149.23131/60/442.70
    Table 3. The matching of feature points of method II, method III and our method. And the root mean square error of four registration methods
    Ying ZHU, Ming ZHAO. Registration of Laser Point Cloud and Optical Image in Urban Area Based on Semantic Segmentation[J]. Acta Photonica Sinica, 2021, 50(1): 188
    Download Citation