Algorithm for Stereo Matching Based on Multi-Task Learning

Yufeng Wang; Hongwei Wang; Yu Liu; Mingquan Yang; Jicheng Quan

doi:10.3788/LOP202158.0415010

[1] Žbontar J. LeCun Y. Computing the stereo matching cost with a convolutional neural network. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 1592-1599(2015).

[2] Žbontar J. LeCun Y. Stereo matching by training a convolutional neural network to compare image patches[J]. Journal of Machine Learning Research, 17, 2287-2318(2016). http://dl.acm.org/citation.cfm?id=2946710

[3] Žbontar J. -10-20)[2020-01-17]. https:∥arxiv., org/abs/1510, 05970(2015).

[4] Park H, Lee K M. Look wider to match image patches with convolutional neural networks[J]. IEEE Signal Processing Letters, 24, 1788-1792(2017). http://ieeexplore.ieee.org/document/7778222/citations?tabFilter=papers

[5] Efficient deep learning for stereo matching. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30 , 2016, Las Vegas, NV, USA. New York: IEEE, 5695-5703(2016).

Luo W J, Seki A, Schwing A G, Urtasun R. September 19-22, 2016, York, UK. London: British Machine Vision Association, 2016: 23.1-, 23, 13(2016).

[6] Seki A, Pollefeys M. SGM-nets: semi-global matching with neural networks. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26 ,2017, Honolulu, HI, USA. New York: IEEE, 6640-6649(2017).

[7] Mayer N, Ilg E, Häusser P et al. A large dataset to train convolutional networks for disparity, optical flow, and scene flow estimation. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30 ,2016, Las Vegas, NV, USA. New York: IEEE, 4040-4048(2016).

[8] Pang J H, Sun W X, Ren J S et al. Cascade residual learning: a two-stage convolutional neural network for stereo matching. [C]∥2017 IEEE International Conference on Computer Vision Workshops (ICCVW), October 22-29 , 2017, Venice, Italy. New York: IEEE, 878-886(2017).

[9] Liang Z F, Feng Y L, Guo Y L et al. Learning for disparity estimation through feature constancy. [C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE, 2811-2820(2018).

[10] Jie Z Q, Wang P F, Ling Y G et al. Left-right comparative recurrent model for stereo matching. [C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE, 3838-3846(2018).

[11] Kendall A, Martirosyan H, Dasgupta S et al. End-to-end learning of geometry and context for deep stereo regression. [C]∥2017 IEEE International Conference on Computer Vision (ICCV), October 22-29,2017, Venice, Italy. New York: IEEE, 66-75(2017).

[12] Chang J R, Chen Y S. Pyramid stereo matching network. [C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23 ,2018, Salt Lake City, UT, USA. New York: IEEE, 5410-5418(2018).

[13] Nie G Y, Cheng M M, Liu Y et al. Multi-level context ultra-aggregation for stereo matching. [C]∥2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 15-20, 2019, Long Beach, CA, USA. New York: IEEE, 3278-3286(2019).

[14] Guo X Y, Yang K, Yang W K et al. Group-wise correlation stereo network. [C]∥2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 15-20 , 2019, Long Beach, CA, USA. New York: IEEE, 3268-3277(2019).

[15] Tulyakov S, Ivanov A. -06-05)[2020-01-17]. http:∥cn.arxiv., org/abs/1806, 01677(2018).

[16] Duggal S, Wang S L, Ma W C et al. DeepPruner: learning efficient stereo matching via differentiable PatchMatch. [C]∥2019 IEEE/CVF International Conference on Computer Vision (ICCV), October 27-November 2 ,2019, Seoul, Korea (South). New York: IEEE, 4383-4392(2019).

[17] Wang Y F, Wang H W, Yu G et al. Stereo matching based on 3D convolutional neural network[J]. Acta Optica Sinica, 39, 1115001(2019).

[18] Cheng X J, Wang P, Yang R G et al. -10-04)[2020-01-17]. http:∥cn.arxiv., org/abs/1810, 02695(2018).

[19] Yang G R, Zhao H S, Shi J P et al. SegStereo: exploiting semantic information for disparity estimation[M]. ∥ Ferrari V, Hebert M, Sminchisescu C, et al.Computer vision — ECCV 2018. Lecture notes in computer science. Cham: Springer, 11211, 660-676(2018).

[20] Song X, Zhao X, Hu H W et al. EdgeStereo: a context integrated residual pyramid network for stereo matching[M]. ∥Jawahar C, Li H, Mori G, et al. Computer vision—ACCV 2018. Lecture notes in computer science. Cham: Springer, 11365, 20-35(2019).

[21] Song X, Zhao X, Fang L J, edge detection[EB/OL] et al. -03-05)[2020-01-17]. http:∥cn.arxiv., org/abs/1903, 01700(2019).

[22] Wang Y F, Wang H W, Liu Y et al. Real-time stereo matching with a hierarchical refinement[J]. Acta Optica Sinica, 40, 0915002(2020).

[23] Zhao H S, Shi J P, Qi X J et al. Pyramid scene parsing network. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26 ,2017, Honolulu, HI, USA. New York: IEEE, 6230-6239(2017).

[24] He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30 ,2016, Las Vegas, NV, USA. New York: IEEE, 770-778(2016).

[25] Ioffe S. -02-11)[2020-01-17]. https:∥arxiv., org/abs/1502, 03167(2015).

[26] Maas A L, Hannun A Y. -06-16)[2020-01-17]. https:∥ai.stanford.edu/~amaas/papers/relu_hybrid_icml2013_final.pdf .(2013).

[27] Girshick R. Fast R-CNN. [C]∥2015 IEEE International Conference on Computer Vision (ICCV), December 7-13, 2015, Santiago, Chile. New York: IEEE, 1440-1448(2015).

[28] Wang Z, Bovik A C, Sheikh H R et al. Image quality assessment: from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 13, 600-612(2004).

[29] Geiger A, Lenz P, Urtasun R. Are we ready for autonomous driving? The KITTI vision benchmark suite. [C]∥2012 IEEE Conference on Computer Vision and Pattern Recognition, June 16-21 ,2012, Providence, RI, USA. New York: IEEE, 3354-3361(2012).

[30] Menze M, Geiger A. Object scene flow for autonomous vehicles. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12 , 2015, Boston, MA, USA. New York: IEEE, 3061-3070(2015).

[31] Scharstein D, Hirschmüller H, Kitajima Y et al. High-resolution stereo datasets with subpixel-accurate ground truth[M]. ∥ Jiang X, Hornegger J, Koch R. GCPR 2014:pattern recognition. Lecture notes in computer science. Cham: Springer, 8753, 31-42(2014).

[32] Schöps T, Schönberger J L, Galliani S et al. A multi-view stereo benchmark with high-resolution images and multi-camera videos. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26 ,2017, Honolulu, HI, USA. New York: IEEE, 2538-2547(2017).

[33] Kingma D P. -12-22)[2020-01-17]. http:∥cn.arxiv., org/abs/1412, 6980(2014).