• Laser & Optoelectronics Progress
  • Vol. 59, Issue 4, 0415008 (2022)
Yaxin Ye1, Jiasheng Wang1, Fengyun Wu1, Siyu Chen1, Puye Ai1, Xiangjun Zou1、2、*, and Lanyun Li2
Author Affiliations
  • 1College of Engineering, South China Agricultural University, Guangzhou , Guangdong 510642, China
  • 2Foshan -Zhongke Innovation Research Institute of Intelligent Agriculture and Robotics, Foshan, Guangdong 528251, China
  • show less
    DOI: 10.3788/LOP202259.0415008 Cite this Article Set citation alerts
    Yaxin Ye, Jiasheng Wang, Fengyun Wu, Siyu Chen, Puye Ai, Xiangjun Zou, Lanyun Li. Target Recognition and Localization, Bounding Box Optimization of Disinfection Robot[J]. Laser & Optoelectronics Progress, 2022, 59(4): 0415008 Copy Citation Text show less
    Annotation effect of dataset samples. (a) Handle; (b) button of elevator; (c) button of light
    Fig. 1. Annotation effect of dataset samples. (a) Handle; (b) button of elevator; (c) button of light
    Workflow of this research
    Fig. 2. Workflow of this research
    Mask R-CNN architecture
    Fig. 3. Mask R-CNN architecture
    Occlusion caused by different viewpoints of two cameras
    Fig. 4. Occlusion caused by different viewpoints of two cameras
    Point cloud edge noise filtering algorithm based on depth statistics. (a) Instance segmentation edge error; (b) edge noise of point clouds; (c) denoising effect
    Fig. 5. Point cloud edge noise filtering algorithm based on depth statistics. (a) Instance segmentation edge error; (b) edge noise of point clouds; (c) denoising effect
    Point cloud registration result. (a) Point cloud from perspective one; (b) point cloud from perspective two; (c) merged point cloud
    Fig. 6. Point cloud registration result. (a) Point cloud from perspective one; (b) point cloud from perspective two; (c) merged point cloud
    Optimization effect of bounding box based on PCA. (a) Simple bounding box; (b) optimized bounding box; (c) optimization effect
    Fig. 7. Optimization effect of bounding box based on PCA. (a) Simple bounding box; (b) optimized bounding box; (c) optimization effect
    Long arm disinfection robot and control debugging experiment scene. (a) Long arm disinfection robot; (b) control debugging experiment scene
    Fig. 8. Long arm disinfection robot and control debugging experiment scene. (a) Long arm disinfection robot; (b) control debugging experiment scene
    Diagram of IoU calculation
    Fig. 9. Diagram of IoU calculation
    Example instance segment result predicted by Mask R-CNN
    Fig. 10. Example instance segment result predicted by Mask R-CNN
    Comparison of surface area of bounding box before and after optimization. (a) Handle; (b) button of elevator; (c) button of light
    Fig. 11. Comparison of surface area of bounding box before and after optimization. (a) Handle; (b) button of elevator; (c) button of light
    Comparison of bounding box volume before and after optimization. (a) Handle; (b) button of elevator; (c) button of light
    Fig. 12. Comparison of bounding box volume before and after optimization. (a) Handle; (b) button of elevator; (c) button of light
    Configuration parameterValue
    Image per GPU1
    Batch size1
    Step per epoch1000
    Image minimum dimension800
    Image maximum dimension1024
    Epoch for training network heads40
    Learning rate for network heads0.001
    Epoch for training ResNet120
    Learning rate for training ResNet0.001
    Epoch for training all layers160
    Learning rate for training all layers0.0001
    Table 1. Configuration list of network training parameters
    CategoryNumber of imagesAPmAP
    Ground truthFalse positiveTrue positive
    Handle913860.9450.968
    Button of elevator580581.000
    Button of light775770.997
    Table 2. Object detection result
    CategoryIoUMean IoU
    Handle0.8730.879
    Button of elevator0.813
    Button of light0.933
    Table 3. Mask R-CNN training results
    CategoryOptimization rateMean optimization rate
    Handle0.2700.292
    Button of elevator0.241
    Button of light0.364
    Table 4. Optimization rate of bounding box surface area for various disinfection targets
    CategoryOptimization rateMean optimization rate
    Handle0.2790.288
    Button of elevator0.245
    Button of light0.372
    Table 5. Optimization rate of bounding box volume for various disinfection targets
    Yaxin Ye, Jiasheng Wang, Fengyun Wu, Siyu Chen, Puye Ai, Xiangjun Zou, Lanyun Li. Target Recognition and Localization, Bounding Box Optimization of Disinfection Robot[J]. Laser & Optoelectronics Progress, 2022, 59(4): 0415008
    Download Citation