• Infrared and Laser Engineering
  • Vol. 50, Issue 8, 20200407 (2021)
Hongyu Chen1、2、3、4、5, Haibo Luo1、2、4、5, Bin Hui1、2、4、5, and Zheng Chang1、2、4、5
Author Affiliations
  • 1Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
  • 2Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
  • 3University of Chinese Academy of Sciences, Beijing 100049, China
  • 4Key Laboratory of Opto-electronic Information Processing, Chinese Academy of Sciences, Shenyang 110016, China
  • 5The Key Lab of Image Understanding and Computer Vision, Liaoning Province, Shenyang 110016, China
  • show less
    DOI: 10.3788/IRLA20200407 Cite this Article
    Hongyu Chen, Haibo Luo, Bin Hui, Zheng Chang. Automatic parts selection method based on multi-feature fusion[J]. Infrared and Laser Engineering, 2021, 50(8): 20200407 Copy Citation Text show less
    Algorithm flow chart
    Fig. 1. Algorithm flow chart
    Response map based on spectral residual visual saliency. (a) Initialized target map; (b) Spectral residual response map; (c) Three-dimensional map of spectral residual response
    Fig. 2. Response map based on spectral residual visual saliency. (a) Initialized target map; (b) Spectral residual response map; (c) Three-dimensional map of spectral residual response
    Illustration of image texture detail. (a) Binary image of Canny edge; (b) Gradient direction amplitude map; (c) Edge direction dispersion map; (d) Three-dimensional map of edge direction dispersion
    Fig. 3. Illustration of image texture detail. (a) Binary image of Canny edge; (b) Gradient direction amplitude map; (c) Edge direction dispersion map; (d) Three-dimensional map of edge direction dispersion
    Illustration of joint suitable-matching confidence map based on multi-feature fusion. (a) Joint suitable-matching confidence map; (b) Three- dimensional map of joint suitable-matching confidence
    Fig. 4. Illustration of joint suitable-matching confidence map based on multi-feature fusion. (a) Joint suitable-matching confidence map; (b) Three- dimensional map of joint suitable-matching confidence
    Result of automatic parts selection
    Fig. 5. Result of automatic parts selection
    Experimental results of proposed method on OTB100 dataset. (a) Results of automatic parts selection on sequence Carscale; (b) Results of automatic parts selection on sequence Dancer2
    Fig. 6. Experimental results of proposed method on OTB100 dataset. (a) Results of automatic parts selection on sequence Carscale; (b) Results of automatic parts selection on sequence Dancer2
    [in Chinese]
    Fig. 6. [in Chinese]
    Experimental results of proposed method on FLIR Thermal dataset. (a) Results of automatic parts selection on the infrared target #1; (b) Results of automatic parts selection on infrared target #2
    Fig. 7. Experimental results of proposed method on FLIR Thermal dataset. (a) Results of automatic parts selection on the infrared target #1; (b) Results of automatic parts selection on infrared target #2
    Experimental results of proposed method on private infrared sequences. (a) Results of automatic parts selection on the private infrared sequence #1; (b) Results of automatic parts selection on the private infrared sequence #2
    Fig. 8. Experimental results of proposed method on private infrared sequences. (a) Results of automatic parts selection on the private infrared sequence #1; (b) Results of automatic parts selection on the private infrared sequence #2
    Distance precision and overlap success rate curves of different algorithms under deformation and occlusion attribute. (a) Distance precision curve of deformation attribute; (b) Overlap success rate curve of deformation attribute; (c) Distance precision curve of occlusion attribute; (d) Overlap success rate curve of deformation attribute
    Fig. 9. Distance precision and overlap success rate curves of different algorithms under deformation and occlusion attribute. (a) Distance precision curve of deformation attribute; (b) Overlap success rate curve of deformation attribute; (c) Distance precision curve of occlusion attribute; (d) Overlap success rate curve of deformation attribute
    Frame-by-frame center location errors of parts from proposed in the paper and manual selection in different sequences
    Fig. 10. Frame-by-frame center location errors of parts from proposed in the paper and manual selection in different sequences
    Aspect ratioNumber of partsWidth of parts ( ${p_w}$) Height of parts ( ${p_h}$) Horizontal margin ( ${M_x}$) Vertical margin ( ${M_y}$)
    $AR \leqslant \dfrac{2}{3}$3$\left\lceil {0.8W} \right\rceil $$\left\lceil {0.8 \times \dfrac{H}{3} } \right\rceil$$\left\lceil {0.05 \times W} \right\rceil$$\left\lceil {0.05 \times H} \right\rceil$
    $\dfrac{2}{3} < AR \leqslant \dfrac{3}{2}$4$\left\lceil {0.8\dfrac{W}{2} } \right\rceil$$\left\lceil {0.8 \times \dfrac{H}{2} } \right\rceil$
    $AR > \dfrac{3}{2}$3$\left\lceil {0.8 \times \dfrac{W}{3} } \right\rceil$$\left\lceil {0.8 \times H} \right\rceil$
    Table 1. Principle of adaptive selection of parts
    SequenceProposedManual selection
    Sylvester2.91244.0036
    Gym10.88815.816
    Dancer27.59058.4727
    Table 2. Mean center location error in different sequences
    Hongyu Chen, Haibo Luo, Bin Hui, Zheng Chang. Automatic parts selection method based on multi-feature fusion[J]. Infrared and Laser Engineering, 2021, 50(8): 20200407
    Download Citation