• Acta Optica Sinica
  • Vol. 39, Issue 2, 0215004 (2019)
Yufeng Wang1、2、*, Hongwei Wang3, Chen Wu1, Yu Liu2, Yuwei Yuan4, and Jicheng Quan1、2、*
Author Affiliations
  • 1 College of Operation Service on Aviation, University of Naval Aviation, Yantai, Shandong 264001, China
  • 2 College of Operation Service on Aviation, Aviation University of Air Force, Changchun, Jilin 130022, China
  • 3 Flight Institute, Aviation University of Air Force, Changchun, Jilin 130022, China
  • 4 The 91977 Troops of the PLA, Beijing 102200, China
  • show less
    DOI: 10.3788/AOS201939.0215004 Cite this Article Set citation alerts
    Yufeng Wang, Hongwei Wang, Chen Wu, Yu Liu, Yuwei Yuan, Jicheng Quan. Self-Supervised Stereo Matching Algorithm Based on Common View[J]. Acta Optica Sinica, 2019, 39(2): 0215004 Copy Citation Text show less
    Schematic of self-supervised stereo matching algorithm
    Fig. 1. Schematic of self-supervised stereo matching algorithm
    GPU memory consumption of different disparity prediction models
    Fig. 2. GPU memory consumption of different disparity prediction models
    Comparison of evaluation results on KITTI2012 training set with randomly initializing model during training process. (a) Training loss; (b) D1; (c) EPE; (d) RPE
    Fig. 3. Comparison of evaluation results on KITTI2012 training set with randomly initializing model during training process. (a) Training loss; (b) D1; (c) EPE; (d) RPE
    Comparison of evaluation results on KITTI2012 training set with pre-training model during fine tuning process. (a) Training loss; (b) D1; (c) EPE; (d) RPE
    Fig. 4. Comparison of evaluation results on KITTI2012 training set with pre-training model during fine tuning process. (a) Training loss; (b) D1; (c) EPE; (d) RPE
    Two sets of images selected from KITTI2015 training set. (a) Left view image in first set. (b) predicted disparity in first set. (c) left view image in second set. (d) predicted disparity in second set
    Fig. 5. Two sets of images selected from KITTI2015 training set. (a) Left view image in first set. (b) predicted disparity in first set. (c) left view image in second set. (d) predicted disparity in second set
    Comparison of practical application effects with pre-training model after fine tuning. (a) Error map in first set; (b) predicted disparity in first set; (c) error map in second set; (d) predicted disparity in second set
    Fig. 6. Comparison of practical application effects with pre-training model after fine tuning. (a) Error map in first set; (b) predicted disparity in first set; (c) error map in second set; (d) predicted disparity in second set
    Image size /pixel×pixelRunning time /s
    DispNet[19]DispNetCorr[19]GC-Net[22]iResNet[21]PSMnet[24]
    375×12420.0740.1006.8480.3753.462
    480×9600.0740.0976.5270.3393.397
    Table 1. Running time of different disparity prediction models
    MethodKITTI2012 training setKITTI2015 training set
    D1 /%EPE /pixelRPE /pixelD1 /%EPE /pixelRPE /pixel
    Method in Ref. [19]14.782.3713.914.990.9113.40
    Method in Ref. [27]14.532.9011.7511.391.959.92
    Method in Ref. [27]-M10.402.7111.386.601.469.46
    Method in Ref. [31]12.982.6911.1310.801.899.48
    Method in Ref. [31]-M10.272.7311.247.551.609.35
    Proposed method10.132.7211.376.781.649.64
    Table 2. Comparison of evaluation results on different datasets after training with randomly initializing model
    MethodKITTI2012 training setKITTI2015 training set
    D1 /%EPE /pixelRPE /pixelD1 /%EPE /pixelRPE /pixel
    Pre-training8.071.5312.138.062.2711.78
    Method in Ref. [19]5.711.3112.742.150.6912.75
    Method in Ref. [27]9.262.2511.297.851.739.71
    Method in Ref. [27]-M7.291.7010.845.911.319.46
    Method in Ref. [31]8.211.9610.747.281.629.27
    Method in Ref. [31]-M7.301.5910.575.951.339.21
    Proposed method6.861.6110.645.961.359.31
    Table 3. Comparison of evaluation results on different datasets with pre-training model after fine tuning
    Yufeng Wang, Hongwei Wang, Chen Wu, Yu Liu, Yuwei Yuan, Jicheng Quan. Self-Supervised Stereo Matching Algorithm Based on Common View[J]. Acta Optica Sinica, 2019, 39(2): 0215004
    Download Citation