• Acta Photonica Sinica
  • Vol. 51, Issue 6, 0610004 (2022)
Kang NI1、2, Yuqing ZHAO3, and Zhi CHEN1、*
Author Affiliations
  • 1School of Computer Science,Nanjing University of Posts and Telecommunications,Nanjing 210023,China
  • 2Jiangsu Key Laboratory of Big Data Security and Intelligent Processing,Nanjing 210023,China
  • 3School of Management and Engineering Capital University of Economics and Business,Beijing 100070,China
  • show less
    DOI: 10.3788/gzxb20225106.0610004 Cite this Article
    Kang NI, Yuqing ZHAO, Zhi CHEN. Multi-scale Convolutional Neural Network Driven by Sparse Second-order Attention Mechanism for Remote Sensing Scene Classification[J]. Acta Photonica Sinica, 2022, 51(6): 0610004 Copy Citation Text show less
    The architecture of MCNN-SSAM
    Fig. 1. The architecture of MCNN-SSAM
    Visualization results of feature maps learned by different network layers
    Fig. 2. Visualization results of feature maps learned by different network layers
    The architecture of sparse second-order attention module
    Fig. 3. The architecture of sparse second-order attention module
    Sample charts of AID dataset
    Fig. 4. Sample charts of AID dataset
    Sample charts of NWPU45 dataset
    Fig. 5. Sample charts of NWPU45 dataset
    Influence of b and v on MCNN-SSAM
    Fig. 6. Influence of b and v on MCNN-SSAM
    Confusion matrix of scene classification on AID dataset under 20% training ratios
    Fig. 7. Confusion matrix of scene classification on AID dataset under 20% training ratios
    Confusion matrix of scene classification on NWPU45 dataset under 20% training ratios
    Fig. 8. Confusion matrix of scene classification on NWPU45 dataset under 20% training ratios
    Visual comparison of heatmaps between MCNN-SSAM and other related networks
    Fig. 9. Visual comparison of heatmaps between MCNN-SSAM and other related networks
    AIDNWPU45
    20%50%10%20%
    AlexNet86.86±0.4789.53±0.3176.69±0.2179.85±0.13
    VGG⁃1686.59±0.2989.64±0.3676.47±0.1879.79±0.15
    SAFF90.25±0.2993.83±0.2884.23±0.1987.86±0.14
    MSCP91.52±0.2194.42±0.1785.33±0.2188.93±0.14
    CapsNet91.63±0.1994.74±0.1785.08±0.1389.18±0.14
    MCNN⁃SSAM91.86±0.0994.98±0.1186.67±0.1090.61±0.11
    Table 1. Performance comparison of other related algorithms
    AID(50%)NWPU45(20%)
    CNNs+SENet91.0183.30
    CNNs+CovNet92.9784.90
    CNNs+SSAM93.3685.22
    MCNN90.7283.21
    MCNN+SENet93.3487.04
    MCNN+CovNet93.9788.97
    MCNN-SSAM94.9890.61
    Table 2. Results of ablation and generalization experiments
    Kang NI, Yuqing ZHAO, Zhi CHEN. Multi-scale Convolutional Neural Network Driven by Sparse Second-order Attention Mechanism for Remote Sensing Scene Classification[J]. Acta Photonica Sinica, 2022, 51(6): 0610004
    Download Citation