• Laser & Optoelectronics Progress
  • Vol. 58, Issue 14, 1415005 (2021)
Hongbin Li, Qinghao Meng, Yuzhe Sun, and Licheng Jin*
Author Affiliations
  • Institute of Robotics and Autonomous System, School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
  • show less
    DOI: 10.3788/LOP202158.1415005 Cite this Article Set citation alerts
    Hongbin Li, Qinghao Meng, Yuzhe Sun, Licheng Jin. Deep Learning-Based Doorplate Detection for Mobile Robot Localization in Indoor Environments[J]. Laser & Optoelectronics Progress, 2021, 58(14): 1415005 Copy Citation Text show less

    Abstract

    Herein, a deep learning-based doorplate detection method was proposed to realize the global positioning of mobile robots in indoor environments. First, the target detection algorithm based on MobileNet-SSD was used to detect the doorplate area of the image acquired using a monocular camera. Second, an improved rotating projection method was proposed to correct oblique images. Third, doorplate number recognition was performed using the k-nearest neighbor algorithm. Fourth, the speeded-up robust feature point matching was performed based on the precollected front-view template pictures of each doorplate. Then, the camera pose solution was achieved based on the PnP problem. Finally, the global positioning of the mobile robot was realized according to the coordinate transformation. Experiments using a mobile robot in an office environment show that the average position error of the mobile robot based on the proposed method is about 7 cm. Moreover, the orientation error is 0.1712 rad, which is reduced by about 50% compared with using only the adaptive Monte Carlo method, and the angle error is reduced by about 57%.
    Hongbin Li, Qinghao Meng, Yuzhe Sun, Licheng Jin. Deep Learning-Based Doorplate Detection for Mobile Robot Localization in Indoor Environments[J]. Laser & Optoelectronics Progress, 2021, 58(14): 1415005
    Download Citation