Optimized Deep Learning Stereo Matching Algorithm

Jihui Huang; Rongfen Zhang; Yuhong Liu; Zhixu Chen; Zipeng Wang

doi:10.3788/LOP202158.2433002

[1] Konolige K. Small vision systems: hardware and implementation[M]. //Robotics research, 203-212(1998).

[2] Hirschmuller H. Stereo processing by semiglobal matching and mutual information[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 328-341(2008).

[3] Xiao H, Tian C, Zhang Y et al. Stereo matching algorithm based on improved Census transform and gradient fusion[J]. Laser & Optoelectronics Progress, 58, 0215008(2021).

[4] Li D H, Shen H Y, Yu X et al. Binocular ranging method using stereo matching based on improved census transform[J]. Laser & Optoelectronics Progress, 56, 111503(2019).

[5] Žbontar J, LeCun Y. Computing the stereo matching cost with a convolutional neural network[C]. //2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA., 1592-1599(2015).

[6] Luo W J, Schwing A G, Urtasun R. Efficient deep learning for stereo matching[C]. //2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA., 5695-5703(2016).

[7] Mayer N, Ilg E, Häusser P et al. A large dataset to train convolutional networks for disparity, optical flow, and scene flow estimation[C]. //2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA., 4040-4048(2016).

[8] Kendall A, Martirosyan H, Dasgupta S et al. End-to-end learning of geometry and context for deep stereo regression[C]. //2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy., 66-75(2017).

[9] Chang J R, Chen Y S. Pyramid stereo matching network[C]. //2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA., 5410-5418(2018).

[10] Zhang F H, Prisacariu V, Yang R G et al. GA-net: Guided aggregation net for end-to-end stereo matching[C]. //2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 15-20, 2019, Long Beach, CA, USA, 185-194(2019).

[11] He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition[C]. //2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA., 770-778(2016).

[12] Khamis S, Fanello S, Rhemann C et al. StereoNet: guided hierarchical refinement for real-time edge-aware depth prediction[M]. // Ferrari V, Hebert M, Sminchisescu C, et al. Computer Vision-ECCV 2018. Lecture notes in computer science, 11219, 596-613(2018).

[13] He K M, Zhang X Y, Ren S Q et al. Spatial pyramid pooling in deep convolutional networks for visual recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37, 1904-1916(2015). http://www.sciencedirect.com/science/article/pii/S0031320315004252

[14] Woo S, Park J, Lee J Y et al. CBAM: convolutional block attention module[M]. //Ferrari V, Hebert M, Sminchisescu C, et al. Computer vision-ECCV 2018. Lecture notes in computer science, 11211, 3-19(2018).

[15] Cheng M Y, Gai S Y, Da F P. A stereo-matching neural network based on attention mechanism[J]. Acta Optica Sinica, 40, 1415001(2020).

[16] Ren S Q, He K M, Girshick R et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 1137-1149(2017).

[17] Menze M, Geiger A. Object scene flow for autonomous vehicles[C]. //2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA., 3061-3070(2015).

[18] Kingma D P, Ba J. Adam: a method for stochastic optimization[EB/OL]. (2014-12-22)[2020-12-10]. https://arxiv.org/abs/1412.6980

[19] Pang J H, Sun W X, Ren J S et al. Cascade residual learning: a two-stage convolutional neural network for stereo matching[C]. //2017 IEEE International Conference on Computer Vision Workshops (ICCVW), October 22-29, 2017, Venice, Italy, 878-886(2017).