Stereo Matching Algorithm Based on Fusion Cost and Segmentation Optimization

Xiaopeng Xie; Yongdong Ou; Yin'an Wang; Zeqiong Huang

doi:10.3788/LOP202158.1215004

[1] Scharstein D, Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms[J]. International Journal of Computer Vision, 47, 7-42(2002).

[2] Zitnick C L, Kanade T. A cooperative algorithm for stereo matching and occlusion detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 675-684(2000). http://search.ebscohost.com/login.aspx?direct=trueu0026db=buhu0026AN=3531303u0026site=ehost-live

[3] Yang Q X, Wang L, Yang R G et al. Stereo matching with color-weighted correlation, hierarchical belief propagation, and occlusion handling[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 492-504(2009).

[4] Sun J, Zheng N N, Shum H Y et al. Stereo matching using belief propagation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 787-800(2003).

[5] Besse F, Rother C, Fitzgibbon A et al. PMBP: PatchMatch belief propagation for correspondence field estimation[J]. International Journal of Computer Vision, 110, 2-13(2014). http://link.springer.com/article/10.1007/s11263-013-0653-9

[6] Gong W B, Gu G H, Qian W X et al. Stereo matching algorithm based on image segmentation and adaptive support weight[J]. Acta Optica Sinica, 35, s210002(2015).

[7] Worby J, Maclean W J. Establishing visual correspondence from multi-resolution graph cuts for stereo-motion[C]. //Fourth Canadian Conference on Computer and Robot Vision (CRV '07), May 28-30, 2007, Montreal, QC, Canada., 313-320(2007).

[8] Hong L, Chen G. Segment-based stereo matching using graph cuts[J]. Proceedings of the IEEE, 1, 74-81(2004). http://ieeexplore.ieee.org/document/1315016

[9] Boykov Y, Veksler O, Zabih R et al. Fast approximate energy minimization via graph cuts[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23, 1222-1239(2001).

[10] Yang Q X. Stereo matching using tree filtering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37, 834-846(2015). http://ieeexplore.ieee.org/document/6888475

[11] Li L C, Yu X, Zhang S L et al. 3D cost aggregation with multiple minimum spanning trees for stereo matching[J]. Applied Optics, 56, 3411-3420(2017).

[12] Liu J G, Yu L, Liu S J et al. Stereo matching algorithm based on improved Census transform and multi-scale space[J]. Journal of South China University of Technology (Natural Science Edition), 45, 43-49(2017).

[13] Ding M, Cao Y F, Wu Q X et al. Crater region detection based on Census transform and Boosting[J]. Journal of Nanjing University of Aeronautics & Astronautics, 41, 682-687(2009).

[14] Zabih R, Woodfill J. Non-parametric local transforms for computing visual correspondence[M]. //Eklundh J O. Computer vision-ECCV '94. Lecture notes in computer science, 801, 151-158(1994).

[15] Žbontar J, Lecun Y. Computing the stereo matching cost with a convolutional neural network[C]. //2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA., 1592-1599(2015).

[16] Mayer N, Ilg E, Häusser P et al. A large dataset to train convolutional networks for disparity, optical flow, and scene flow estimation[C]. //2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA., 4040-4048(2016).

[17] Cheng M Y, Gai S Y, Da F P et al. A stereo-matching neural network based on attention mechanism[J]. Acta Optica Sinica, 40, 1415001(2020).

[18] Wang Y F, Wang H W, Yu G et al. Stereo matching algorithm based on three-dimensional convolutional neural network[J]. Acta Optica Sinica, 39, 1115001(2019).

[19] Tulyakov S, Ivanov A, Fleuret F et al. Weakly supervised learning of deep metrics for stereo reconstruction[C]. //2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy., 1348-1357(2017).

[20] Heo Y S, Lee K M, Lee S U et al. Robust stereo matching using adaptive normalized cross-correlation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 807-822(2011).

[21] Zhang K, Lu J B, Lafruit G et al. Cross-based local stereo matching using orthogonal integral images[J]. IEEE Transactions on Circuits and Systems for Video Technology, 19, 1073-1079(2009).

[22] Hirschmuller H. Stereo processing by semiglobal matching and mutual information[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 328-341(2008).

[23] Birchfield S, Tomasi C. Depth discontinuities by pixel-to-pixel stereo[C]. //Sixth International Conference on Computer Vision, January 7, 1998, Bombay, India., 1073-1080(1998).

[24] Ma Q Q, Wang C F. Non-local stereo matching algorithm based on color and edge information[J]. Laser & Optoelectronics Progress, 57, 101020(2020).

[25] Wang Y P, Qin A N, Hao Q et al. Semi-global stereo matching of remote sensing images combined with speeded up robust features[J]. Acta Optica Sinica, 40, 1628003(2020).

[26] Felzenszwalb P F, Huttenlocher D P. Efficient graph-based image segmentation[J]. International Journal of Computer Vision, 59, 167-181(2004). http://www.mendeley.com/research/effcient-graphbased-image-segmentation/

[27] Peña D, Sutherland A. Disparity estimation by simultaneous edge drawing[M]. //Chen C S, Lu J W, Ma K K. Computer vision-ACCV 2016 workshops. Lecture notes in computer science, 10117, 124-135(2017).

[28] Keselman L, Woodfill J I, Jepsen A G et al. Intel(R) RealSense(TM) stereoscopic depth cameras[C]. //2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), July 21-26, 2017, Honolulu, HI, USA., 1267-1276(2017).

[29] Shahbazi M, Sohn G, Théau J et al. Revisiting intrinsic curves for efficient dense stereo matching[J]. ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, 3, 123-130(2016). http://adsabs.harvard.edu/abs/2016ISPAnIII3..123S

[30] Jellal R A, Lange M, Wassermann B et al. LS-ELAS: line segment based efficient large scale stereo matching[C]. //2017 IEEE International Conference on Robotics and Automation (ICRA), May 29-June 3, 2017, Singapore, 146-152(2017).

[31] Mei X, Sun X, Zhou M C et al. On building an accurate stereo matching system on graphics hardware[C]. //2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), November 6-13, 2011, Barcelona, Spain., 467-474(2011).

[32] Ma N, Men Y B, Men C G et al. Accurate dense stereo matching based on image segmentation using an adaptive multi-cost approach[J]. Symmetry, 8, 159(2016).