• Acta Photonica Sinica
  • Vol. 49, Issue 12, 61 (2020)
Lei ZHANG1、2, Xiao-bin XU1、2, Jia HE1、2, Kai-yua ZHU1、2, Min-zhou LUO1、2, and Zhi-ying TAN1、2
Author Affiliations
  • 1College of Mechanical & Electrical Engineering, Hohai University, Changzhou, Jiangsu23022, China
  • 2Jiangsu Key Laboratory of Special Robot Technology, Hohai University, Changzhou, Jiangsu130, China
  • show less
    DOI: 10.3788/gzxb20204912.1214001 Cite this Article
    Lei ZHANG, Xiao-bin XU, Jia HE, Kai-yua ZHU, Min-zhou LUO, Zhi-ying TAN. Calibration Method of 2D LIDAR and Camera Based on Indoor Structural Features[J]. Acta Photonica Sinica, 2020, 49(12): 61 Copy Citation Text show less

    Abstract

    Aiming at the problem of LIDAR and camera data fusion, a calibration method of 2D LIDAR and color camera based on indoor structural features was proposed. According to the position relationship between the point and lines, pillar features of the indoor scene are used to derive the projection matrix equation between the 2D LIDAR and the camera coordinate systems. The Canny operator and Hough transform are employed to extract the line features of the corner image. Afterwards, the RANSAC method is used to fit the corner features from the point cloud. The projection matrix is solved by the singular value decomposition method. Finally, the calibration results are further optimized after removing the data with large reprojection errors. The experimental results show that the average reprojection error of the pillar feature point is reduced from 0.375 5 pixels to 0.045 9 pixels by adopting optimized projection matrix. Compared with the two-step calibration method, the algorithm proposed in this paper has a better reprojection effect. At the same time, this method does not require a specific calibration object, and can achieve high projection accuracy in less time.
    suv1=fu0u00fvv0001RT01xy01=m11m12m13m14m21m22m23m24m31m32m33m34xy01(1)

    View in Article

    su=xm11+ym12+m14sv=xm21+ym22+m24s=xm31+ym32+m34(2)

    View in Article

    u=m11x+m12y+m14m31x+m32y+m34v=m21x+m22y+m24m31x+m32y+m34(3)

    View in Article

    au+bv+c=0(4)

    View in Article

    am11x+m12y+m14+bm21x+m22y+m24+cm31x+m32y+m34=0(5)

    View in Article

    axayabxbybcxcycm11m12m14m21m22m24m31m32m34=0(6)

    View in Article

    a=v2-v1b=u1-u2c=u2·v1-u1·v2(7)

    View in Article

    0.533415788500835-0.7885954646539430.03207461813412720.2897005240005070.01495974128462370.09167062524355980.001518339840025557.13304495916862×10-58.44683110335785×10-5(8)

    View in Article

    -0.53397550887160.7874988583552-0.0324878391024-0.2914556394668-0.01181069290484-0.0925852970074-0.001520664513136-7.249957372551×10-5-8.474819773266×10-5(9)

    View in Article

    Lei ZHANG, Xiao-bin XU, Jia HE, Kai-yua ZHU, Min-zhou LUO, Zhi-ying TAN. Calibration Method of 2D LIDAR and Camera Based on Indoor Structural Features[J]. Acta Photonica Sinica, 2020, 49(12): 61
    Download Citation