• Acta Optica Sinica
  • Vol. 40, Issue 16, 1628005 (2020)
Zhuqiang Li1、*, Ruifei Zhu1、2, Jingyu Ma1, Xiangyu Meng3, Dong Wang1、2, and Siyan Liu1
Author Affiliations
  • 1Key Laboratory of Satellite Remote Sensing Application Technology of Jilin Province, Chang Guang Satellite Technology Co., Ltd., Changchun, Jilin 130000, China
  • 2Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, Jilin 130033, China
  • 3Jilin Province Land Survey & Planning Institute, Changchun, Jilin 130061, China;
  • show less
    DOI: 10.3788/AOS202040.1628005 Cite this Article Set citation alerts
    Zhuqiang Li, Ruifei Zhu, Jingyu Ma, Xiangyu Meng, Dong Wang, Siyan Liu. Airport Detection Method Combined with Continuous Learning of Residual-Based Network on Remote Sensing Image[J]. Acta Optica Sinica, 2020, 40(16): 1628005 Copy Citation Text show less
    Flow chart of airport detection method combined with continuous learning of residual-based network
    Fig. 1. Flow chart of airport detection method combined with continuous learning of residual-based network
    Constructing airport object core set by binary tree method
    Fig. 2. Constructing airport object core set by binary tree method
    Airport object detection network structure combined with residual block network
    Fig. 3. Airport object detection network structure combined with residual block network
    Improve the scale of anchor in RPN for airport object
    Fig. 4. Improve the scale of anchor in RPN for airport object
    Visualization of the feature map of the target in the image by the residual network. (a) Original true color image; (b) feature map from 64 convolution kernels; (c) feature map from 1024 convolution kernels; (d) feature heat map obtained from classification regression and border regression
    Fig. 5. Visualization of the feature map of the target in the image by the residual network. (a) Original true color image; (b) feature map from 64 convolution kernels; (c) feature map from 1024 convolution kernels; (d) feature heat map obtained from classification regression and border regression
    Verification set loss function decline curve and accuracy test. (a) Loss value decline curve; (b) accuracy test curve
    Fig. 6. Verification set loss function decline curve and accuracy test. (a) Loss value decline curve; (b) accuracy test curve
    Airport object detection results in remote sensing images under different background environments. (a) Test result in hilly area environment; (b) test result in desert environment; (c) test result in an island environment; (d) test result in port environment
    Fig. 7. Airport object detection results in remote sensing images under different background environments. (a) Test result in hilly area environment; (b) test result in desert environment; (c) test result in an island environment; (d) test result in port environment
    Misclassification caused by background texture similar to airport objects. (a) Bridge facilities; (b) industrial park; (c) highway; (d) structured experimental field
    Fig. 8. Misclassification caused by background texture similar to airport objects. (a) Bridge facilities; (b) industrial park; (c) highway; (d) structured experimental field
    Airport object detection results under interference conditions. (a) Cloud interference; (b) sweeping incomplete; (c) large difference in object scale in the same image; (d) small airport
    Fig. 9. Airport object detection results under interference conditions. (a) Cloud interference; (b) sweeping incomplete; (c) large difference in object scale in the same image; (d) small airport
    Comparison of airport detection results in continuous learning mode. (a) CLRNet 1st stage detection results under the condition that the target texture shape is similar to the airport; (b) CLRNet 2nd stage detection result under the condition that the target texture shape is similar to the airport; (c) CLRNet 1st stage detection result under background environment interference; (d) CLRNet 2nd stage detection result under background environment interference
    Fig. 10. Comparison of airport detection results in continuous learning mode. (a) CLRNet 1st stage detection results under the condition that the target texture shape is similar to the airport; (b) CLRNet 2nd stage detection result under the condition that the target texture shape is similar to the airport; (c) CLRNet 1st stage detection result under background environment interference; (d) CLRNet 2nd stage detection result under background environment interference
    YearOriginal panchromatic resolution /mOriginal multispectral resolution /mNetwork input resolution /mDetected number /sceneTotal images /scene
    20160.722.8814.4238763645
    20170.722.8814.4120647863
    20180.72--0.922.88--3.6814.4--18.44401172311
    20190.72--1.062.88--4.2414.4--22.04200191311
    Table 1. Airport object remote sensing dataset of Jilin-1
    ModuleKernels' numberConvolution parameterInputOutput
    Conv 164K:7×7, s:2, p:3896×896×3448×448×64
    MaxPooling 164K:3×3, s:2, p:1448×448×64224×224×64
    Conv 264K:1×1, s:1224×224×64224×224×64
    Conv 3192K:3×3, s:2, p:1224×224×64112×112×192
    MaxPooling 2192K:3×3, s:2, p:1112×112×19256×56×192
    Conv 4192K:3×3, s:1, p:156×56×19256×56×192
    MaxPooling 3192K:3×3, s:2, p:156×56×19228×28×192
    Residual block 1256Krb1:3×3, Krb2:1×128×28×19228×28×256
    Residual block 2320Krb1:3×3, Krb2:1×128×28×25628×28×320
    Residual block 3(×3)576Krb1:3×3, Krb2:1×128×28×32014×14×512
    RPN Conv256K:3×3, s:1, p:114×14×51214×14×256
    ROI Pooling--14×14×2564096×1
    Fully connected layer--4096×12048×1
    Table 2. Airport object detection network structure combined with residual block network
    MethodPrecisionRecallmAP50Average detection time/s
    SSD[16]0.92010.93550.88170.12
    YOLOv3[17]0.93220.94120.84460.09
    Faster R-CNN[18]0.95000.96310.93180.75
    Method of Ref. [19]0.96710.94650.94510.34
    CLRNet 1st stage0.97200.95810.94770.23
    CLRNet 2nd stage0.98720.99130.96130.23
    Table 3. Precision and efficiency of different detection methods for airport object
    Zhuqiang Li, Ruifei Zhu, Jingyu Ma, Xiangyu Meng, Dong Wang, Siyan Liu. Airport Detection Method Combined with Continuous Learning of Residual-Based Network on Remote Sensing Image[J]. Acta Optica Sinica, 2020, 40(16): 1628005
    Download Citation