• Laser & Optoelectronics Progress
  • Vol. 56, Issue 7, 071502 (2019)
Cong Tang1、2、*, Yongshun Ling1、2, Hua Yang1、2, Xing Yang1、2, and Wuqin Tong3
Author Affiliations
  • 1 College of Electronic Countermeasures, National University of Defense Technology, Hefei, Anhui 230037, China
  • 2 State Key Laboratory of Pulsed Power Laser Technology, Hefei, Anhui 230037, China
  • 3 South-West Electron and Telecom Technology Institute, Chengdu, Sichuan 610041, China
  • show less
    DOI: 10.3788/LOP56.071502 Cite this Article Set citation alerts
    Cong Tang, Yongshun Ling, Hua Yang, Xing Yang, Wuqin Tong. Decision-Level Fusion Tracking for Infrared and Visible Spectra Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2019, 56(7): 071502 Copy Citation Text show less
    Tracking drift using several classic tracking methods. (a) Algorithm in Ref. [9]; (b) algorithm in Ref. [14]; (c) algorithm in Ref. [15]; (d) algorithm in Ref. [16]
    Fig. 1. Tracking drift using several classic tracking methods. (a) Algorithm in Ref. [9]; (b) algorithm in Ref. [14]; (c) algorithm in Ref. [15]; (d) algorithm in Ref. [16]
    Infrared images dataset (examples). (a) Bicycle; (b) bus; (c) car; (d) motorbike; (e) pedestrian
    Fig. 2. Infrared images dataset (examples). (a) Bicycle; (b) bus; (c) car; (d) motorbike; (e) pedestrian
    Training loss versus number of iterations
    Fig. 3. Training loss versus number of iterations
    Test accuracy versus number of iterations
    Fig. 4. Test accuracy versus number of iterations
    Decision-level fusion tracking for infrared and visible spectra based on deep learning
    Fig. 5. Decision-level fusion tracking for infrared and visible spectra based on deep learning
    Process of decision-level fusion tracking
    Fig. 6. Process of decision-level fusion tracking
    Tracking results(frame sequence number is 1, 15, 32, 55, 129, 143, 162). (a) Infrared tracking; (b) visible tracking; (c) fusion tracking infrared and visible
    Fig. 7. Tracking results(frame sequence number is 1, 15, 32, 55, 129, 143, 162). (a) Infrared tracking; (b) visible tracking; (c) fusion tracking infrared and visible
    Comparison of overlap score between dual-band fusion and single band tracking
    Fig. 8. Comparison of overlap score between dual-band fusion and single band tracking
    Comparison of centre location error between dual-band fusion and single band tracking
    Fig. 9. Comparison of centre location error between dual-band fusion and single band tracking
    mAPAP
    BicycleBusCarMotorbikePerson
    0.8230.7880.8960.8640.8060.758
    Table 1. mAP of five classes on infrared test datasets
    PerformanceVisibletrackingInfraredtrackingFusiontracking
    Average overlapscore /%61.866.474.0
    Average centrelocation error /pixel14.68.84.0
    Target loss rate0.230.110
    Table 2. Performance comparison between dual-band fusion tracking and single band tracking
    Cong Tang, Yongshun Ling, Hua Yang, Xing Yang, Wuqin Tong. Decision-Level Fusion Tracking for Infrared and Visible Spectra Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2019, 56(7): 071502
    Download Citation