• Opto-Electronic Engineering
  • Vol. 49, Issue 9, 220024 (2022)
Kangliang Lu1, Jun Xue1, and Chongben Tao1、2、*
Author Affiliations
  • 1School of Electronics and Information Engineering, Suzhou University of Science and Technology, Suzhou, Jiangsu 215009, China
  • 2Tsinghua University Suzhou Automotive Research Institute, Suzhou, Jiangsu 215134, China
  • show less
    DOI: 10.12086/oee.2022.220024 Cite this Article
    Kangliang Lu, Jun Xue, Chongben Tao. Multi target tracking based on spatial mask prediction and point cloud projection[J]. Opto-Electronic Engineering, 2022, 49(9): 220024 Copy Citation Text show less
    Algorithm frame diagram
    Fig. 1. Algorithm frame diagram
    Mask prediction module
    Fig. 2. Mask prediction module
    Prediction module
    Fig. 3. Prediction module
    Point cloud projection
    Fig. 4. Point cloud projection
    Calibration board effect
    Fig. 5. Calibration board effect
    Mask projection
    Fig. 6. Mask projection
    Input sequence RGB and mask data into the model. (a) Original sequence RGB data; (b) Corresponding sequence mask data
    Fig. 7. Input sequence RGB and mask data into the model. (a) Original sequence RGB data; (b) Corresponding sequence mask data
    Loss function curve. (a) Four definitions of loss; (b) Total algorithm loss
    Fig. 8. Loss function curve. (a) Four definitions of loss; (b) Total algorithm loss
    PR curve comparison
    Fig. 9. PR curve comparison
    The accuracy of the three algorithms for different distance, occlusion, luminosity and ambiguity
    Fig. 10. The accuracy of the three algorithms for different distance, occlusion, luminosity and ambiguity
    Performance of multiple target tracking algorithms on MOT
    Fig. 11. Performance of multiple target tracking algorithms on MOT
    Effect of Apollo dataset test
    Fig. 12. Effect of Apollo dataset test
    Effect of KITTI dataset test
    Fig. 13. Effect of KITTI dataset test
    Effect of BDD100K dataset test
    Fig. 14. Effect of BDD100K dataset test
    Effect of point cloud projection
    Fig. 15. Effect of point cloud projection
    Experimental platform
    Fig. 16. Experimental platform
    Effect of actual road experiment
    Fig. 17. Effect of actual road experiment
    MethodBackbonemsrcEpochsAPAP50AP75APSAPMAPLAPbbfps
    Mask R-CNN [19]R-50-FPN1234.656.536.615.336.349.738.08.6
    Mask R-CNNR-101-FPN1236.258.638.516.438.452.040.18.1
    Mask R-CNNR-101-FPN3638.160.940.718.440.253.442.68.7
    YOLACT-700 [21]R-101-FPN4831.250.632.812.133.347.1-23.6
    OursR-50-FPN1233.654.535.415.135.947.338.216.7
    OursR-101-FPN3637.759.140.317.940.453.042.513.7
    Ours-600R-101-FPN3635.255.937.312.437.354.940.221.7
    Table 1. This algorithm is compared with other algorithms
    MethodsMOTSAMOTSAMOTSP
      KITTI mots dataset-carsMask R-CNN74.985.885.1
    MaskTrackR-CNN [25]75.586.186.5
    Track R-CNN [26]76.286.887.2
    Ours77.687.886.3
      KITTI mots dataset-pedestrainsMask R-CNN44.663.874.1
    MaskTrack R-CNN45.964.677.9
    Track R-CNN46.865.175.7
    Ours45.365.677.0
    Table 2. Performance index
    Kangliang Lu, Jun Xue, Chongben Tao. Multi target tracking based on spatial mask prediction and point cloud projection[J]. Opto-Electronic Engineering, 2022, 49(9): 220024
    Download Citation