• Journal of Infrared and Millimeter Waves
  • Vol. 42, Issue 5, 701 (2023)
Xin-Yi YE1,2, Si-Li GAO2, and Fan-Ming Li2,*
Author Affiliations
  • 1School of Information Science and Technology,ShanghaiTech University,Shanghai 201210,China
  • 2Key Laboratory of Infrared System Detection and Imaging Technology,Shanghai Institute of Technical Physics,Chinese Academy of Sciences,Shanghai 200083,China
  • show less
    DOI: 10.11972/j.issn.1001-9014.2023.05.015 Cite this Article
    Xin-Yi YE, Si-Li GAO, Fan-Ming Li. ACE-STDN: An infrared small target detection network with adaptive contrast enhancement[J]. Journal of Infrared and Millimeter Waves, 2023, 42(5): 701 Copy Citation Text show less
    The training pipeline of the proposed ACE-STDN framework. Our method consists of two subnetworks to preprocess the infrared image and detect small targets respectively. The contrast enhancement subnetwork aids the small target detection subnetwork to achieve better performance,especially for dim targets.
    Fig. 1. The training pipeline of the proposed ACE-STDN framework. Our method consists of two subnetworks to preprocess the infrared image and detect small targets respectively. The contrast enhancement subnetwork aids the small target detection subnetwork to achieve better performance,especially for dim targets.
    The adaptive contrast enhancement subnetwork for infrared images. This network consists of three main modules,where gray arrows denote convolution layers,and the green ones are deconvolution layers
    Fig. 2. The adaptive contrast enhancement subnetwork for infrared images. This network consists of three main modules,where gray arrows denote convolution layers,and the green ones are deconvolution layers
    The structure of the transformer encoder block and TSConv block.
    Fig. 3. The structure of the transformer encoder block and TSConv block.
    The architecture of the detection subnetwork
    Fig. 4. The architecture of the detection subnetwork
    Two different frameworks:(a)the framework of YOLOv5;(b)our improved framework
    Fig. 5. Two different frameworks:(a)the framework of YOLOv5;(b)our improved framework
    Infrared small-dim targets in the real world and their local intensity distribution:(a)simple background;(b)complex background
    Fig. 6. Infrared small-dim targets in the real world and their local intensity distribution:(a)simple background;(b)complex background
    The schematic diagram of measurements using a discrete bounding box and 2D Gaussian Distribution
    Fig. 7. The schematic diagram of measurements using a discrete bounding box and 2D Gaussian Distribution
    Illustration of detection results on ATDT
    Fig. 8. Illustration of detection results on ATDT
    Illustration of detection results on SIRST
    Fig. 9. Illustration of detection results on SIRST
    Illustration of detection results on a multiclass infrared dataset
    Fig. 10. Illustration of detection results on a multiclass infrared dataset
    Illustration of detection results on a multiclass RGB dataset
    Fig. 11. Illustration of detection results on a multiclass RGB dataset
    ModelHBACESNNWDAP
    A88.25%
    B93.02%
    C92.48%
    D93.76%
    Table 1. Ablation study on ATDT
    ModelAverage PrecisionInference Time
    YOLOv587.27%5.3 ms
    ViT59.63%5.5 ms
    TPH-YOLOv574.95%8.7 ms
    ACE-STDN93.76%4.8 ms
    Table 2. Comparison with generic detection method on ATDT
    MethodPrecisionRecallF1-score
    TopHat0.68730.08180.1461
    LCM0.62010.14430.2341
    NRAM0.75490.15440.2563
    IPI0.76400.18130.2931
    ACE-STDN0. 85370.83620.8448
    Table 3. Comparison with generic detection method on SIRST
    Xin-Yi YE, Si-Li GAO, Fan-Ming Li. ACE-STDN: An infrared small target detection network with adaptive contrast enhancement[J]. Journal of Infrared and Millimeter Waves, 2023, 42(5): 701
    Download Citation