• Laser & Optoelectronics Progress
  • Vol. 58, Issue 4, 0415010 (2021)
Yufeng Wang1、2, Hongwei Wang2、3、*, Yu Liu2, Mingquan Yang2, and Jicheng Quan1、2、*
Author Affiliations
  • 1University of Naval Aviation, Yantai, Shandong 264001, China
  • 2Aviation University of Air Force, Changchun, Jilin 130022, China
  • 3Information Engineering University, Zhengzhou, Henan 450001, China
  • show less
    DOI: 10.3788/LOP202158.0415010 Cite this Article Set citation alerts
    Yufeng Wang, Hongwei Wang, Yu Liu, Mingquan Yang, Jicheng Quan. Algorithm for Stereo Matching Based on Multi-Task Learning[J]. Laser & Optoelectronics Progress, 2021, 58(4): 0415010 Copy Citation Text show less

    Abstract

    The introduction of auxiliary task information is helpful for the stereo matching model to understand the related knowledge, but the complexity of model training increases. In order to solve the problem of dependence on extra label data during model training, we proposed an algorithm based on multi-task learning for stereo matching by using the autocorrelation of binocular images. This algorithm introduces the edge and feature consistency information in the multi-level progressive refinement process and updates the disparity map in a cyclic and iterative manner. According to the local smoothness of disparity and the consistency of left and right features of binocular images, a loss function is constructed to guide the model to learn the edge and feature consistency information without relying on additional label data. A spatial pyramid pooling with scale attention is proposed to enable the model to determine the importance of different scale features based on the local image features in different areas. The experimental results show that the introduction of auxiliary tasks not only improves the accuracy of disparity maps, but also provides a significant basis for the trusted regions of disparity maps. It can also be used to determine the single-view visible areas in unsupervised learning. The proposed algorithm has certain competitiveness in terms of accuracy and operating efficiency on the KITTI2015 test dataset.
    Yufeng Wang, Hongwei Wang, Yu Liu, Mingquan Yang, Jicheng Quan. Algorithm for Stereo Matching Based on Multi-Task Learning[J]. Laser & Optoelectronics Progress, 2021, 58(4): 0415010
    Download Citation