Stereo Matching Algorithm Based on Three-Dimensional Convolutional Neural Network

Yufeng Wang; Hongwei Wang; Guang Yu; Mingquan Yang; Yuwei Yuan; Jicheng Quan

doi:10.3788/AOS201939.1115001

[1] Nguyen V D, Nguyen D D, Lee S J et al. Local density encoding for robust stereo matching[J]. IEEE Transactions on Circuits and Systems for Video Technology, 24, 2049-2062(2014). http://ieeexplore.ieee.org/iel7/76/6971052/06846321.pdf

[2] Heise P, Jensen B, Klose S et al. Fast dense stereo correspondences by binary locality sensitive hashing. [C]//2015 IEEE International Conference on Robotics and Automation (ICRA), May 26-30, 2015, Seattle, WA, USA. New York: IEEE, 105-110(2015).

[3] Taniai T, Matsushita Y, Sato Y et al. Continuous 3D label stereo matching using local expansion moves[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 2725-2739(2018).

[4] Hamzah R A, Ibrahim H. Hassan A H A. Stereo matching algorithm based on per pixel difference adjustment, iterative guided filter and graph segmentation[J]. Journal of Visual Communication and Image Representation, 42, 145-160(2017). http://www.sciencedirect.com/science/article/pii/S1047320316302450

[5] He K M, Zhang X Y, Ren S Q et al. Identity mappings in deep residual networks[M]. //Leibe B, Matas J, Sebe N, et al. European conference on computer vision-ECCV 2016. Lecture notes in computer science. Cham: Springer, 9908, 630-645(2016).

[6] Ren S Q, He K M, Girshick R et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 1137-1149(2017).

[7] Shelhamer E, Long J, Darrell T. Fully convolutional networks for semantic segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 640-651(2017).

[8] Xiao J S, Tian H, Zou W T et al. Stereo matching based on convolutional neural network[J]. Acta Optica Sinica, 38, 0815017(2018).

[9] Žbontar J. LeCun Y. Computing the stereo matching cost with a convolutional neural network. [C]//2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 1592-1599(2015).

[10] Žbontar J. LeCun Y. Stereo matching by training a convolutional neural network to compare image patches[J]. Journal of Machine Learning Research, 17, 2287-2318(2016).

[11] Mayer N, Ilg E, Häusser P et al. A large dataset to train convolutional networks for disparity, optical flow, and scene flow estimation. [C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 4040-4048(2016).

[12] Pang J H, Sun W X, Ren J S et al. Cascade residual learning: a two-stage convolutional neural network for stereo matching. [C]//2017 IEEE International Conference on Computer Vision Workshops (ICCVW), October 22-29, 2017, Venice, Italy. New York: IEEE, 878-886(2017).

[13] Kendall A, Martirosyan H, Dasgupta S et al. End-to-end learning of geometry and context for deep stereo regression. [C]//2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy. New York: IEEE, 66-75(2017).

[14] Chang J R, Chen Y S. Pyramid stereo matching network. [C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE, 5410-5418(2018).

[15] Scharstein D, Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms[J]. International Journal of Computer Vision, 47, 7-42(2002). http://portal.acm.org/citation.cfm?id=598475

[16] Scharstein D, Hirschmüller H, Kitajima Y et al. High-resolution stereo datasets with subpixel-accurate ground truth[M]. //Jiang X, Hornegger J, Koch R. German conference on pattern recognition. GCPR 2014.Lecture notes in computer science. Cham: Springer, 8753, 31-42(2014).

[17] Geiger A, Lenz P, Urtasun R. Are we ready for autonomous driving? The KITTI vision benchmark suite. [C]//2012 IEEE Conference on Computer Vision and Pattern Recognition, June 16-21, 2012, Providence, RI, USA. New York: IEEE, 3354-3361(2012).

[18] Menze M, Geiger A. Object scene flow for autonomous vehicles. [C]//2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 3061-3070(2015).

[19] Luo W J, Schwing A G, Urtasun R. Efficient deep learning for stereo matching. [C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 5695-5703(2016).

[20] Liang Z F, Feng Y L, Guo Y L et al. Learning for disparity estimation through feature constancy. [C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE, 2811-2820(2018).

[21] Jie Z Q, Wang P F, Ling Y G et al. Left-right comparative recurrent model for stereo matching. [C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE, 3838-3846(2018).

[23] Smolyanskiy N, Kamenev A, Birchfield S. On the importance of stereo for accurate depth estimation: an efficient semi-supervised deep neural network approach. [C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), June 18-22, 2018, Salt Lake City, UT, USA. New York: IEEE, 1120-1128(2018).

[25] Wang Y F, Wang H W, Wu C et al. Self-supervised stereo matching algorithm based on common view[J]. Acta Optica Sinica, 39, 0215004(2019).

[26] Girshick R. Fast R-CNN. [C]//2015 IEEE International Conference on Computer Vision (ICCV), December 7-13, 2015, Santiago, Chile. New York: IEEE, 1440-1448(2015).