• Acta Optica Sinica
  • Vol. 37, Issue 10, 1010003 (2017)
Lei Qu1、2、*, Kangru Wang1、2, Lili Chen1, Jiamao Li1, and Xiaolin Zhang1
Author Affiliations
  • 1 Laboratory of Bionic Vision System, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China
  • 2 University of Chinese Academy of Sciences, Beijing 100049, China
  • show less
    DOI: 10.3788/AOS201737.1010003 Cite this Article Set citation alerts
    Lei Qu, Kangru Wang, Lili Chen, Jiamao Li, Xiaolin Zhang. Fast Road Detection Based on RGBD Images and Convolutional Neural Network[J]. Acta Optica Sinica, 2017, 37(10): 1010003 Copy Citation Text show less
    Simulation of typical road scenes. (a)-(c) Road surfaces with different longitudinal slopes; (d)-(j) object surfaces with different orientations
    Fig. 1. Simulation of typical road scenes. (a)-(c) Road surfaces with different longitudinal slopes; (d)-(j) object surfaces with different orientations
    Simulated disparity images, disparity gradient images and binarized disparity gradient images. (a) Level road; (b) uphill road; (c) downhill road; (d) left-side plane of the vehicle; (e) right-side plane of the vehicle; (f) forward plane of the vehicle; (g) backward plane of the vehicle; (h) left oblique plane of the vehicle; (i) right oblique plane of the vehicle; (j) vertical plane
    Fig. 2. Simulated disparity images, disparity gradient images and binarized disparity gradient images. (a) Level road; (b) uphill road; (c) downhill road; (d) left-side plane of the vehicle; (e) right-side plane of the vehicle; (f) forward plane of the vehicle; (g) backward plane of the vehicle; (h) left oblique plane of the vehicle; (i) right oblique plane of the vehicle; (j) vertical plane
    Flowchart of double-path convolutional neural network with late fusion
    Fig. 3. Flowchart of double-path convolutional neural network with late fusion
    Experimental results of KITTI road detection testing dataset. (a)(c) Method of Ref. [4]; (b)(d) proposed RGB-DT-IN algorithm
    Fig. 4. Experimental results of KITTI road detection testing dataset. (a)(c) Method of Ref. [4]; (b)(d) proposed RGB-DT-IN algorithm
    Convolutional output visualization of road images. (a) Color and gradient maps of input four channel; (b) output results of convergence layer
    Fig. 5. Convolutional output visualization of road images. (a) Color and gradient maps of input four channel; (b) output results of convergence layer
    Convolutional output visualization of non-road images. (a) Color and gradient maps of input four channel; (b) output results of convergence layer
    Fig. 6. Convolutional output visualization of non-road images. (a) Color and gradient maps of input four channel; (b) output results of convergence layer
    No.MethodMaxF1IoUPreRecFPRFNR
    1RGB93.7688.7595.7592.500.627.50
    2RGBD92.2586.5788.3197.922.262.08
    3RGBDT94.9690.9694.9595.680.804.32
    4RGB-DT95.2791.5693.9697.361.002.64
    5RGBDT-IN95.1891.4694.2196.970.963.03
    6RGB-DT-IN95.3791.7395.0096.420.783.58
    Table 1. Evaluation results of different methods on the common dataset%
    No.MethodMaxF1IoUPreRecFPRFNR
    1RGB83.4375.3586.0383.191.8216.81
    2RGBD88.0179.8484.5194.252.815.75
    3RGBDT93.5588.7293.3894.811.025.19
    4RGB-DT94.1289.3795.8393.260.616.74
    5RGBDT-IN94.3289.9794.3995.300.924.70
    6RGB-DT-IN95.0191.1194.6296.250.863.75
    Table 2. Evaluation results of different methods on the difficult dataset%
    MethodForward timePrediction time
    Ref. [4]0.0250.032
    RGB0.0330.037
    RGBDT-IN0.0340.038
    RGB-DT-IN0.0630.067
    Table 3. Processing time of methodss
    Lei Qu, Kangru Wang, Lili Chen, Jiamao Li, Xiaolin Zhang. Fast Road Detection Based on RGBD Images and Convolutional Neural Network[J]. Acta Optica Sinica, 2017, 37(10): 1010003
    Download Citation