• Journal of Infrared and Millimeter Waves
  • Vol. 39, Issue 4, 473 (2020)
Yu-Xi LIU, Bo ZHANG, and Bin WANG*
Author Affiliations
  • Key Laboratory for Information Science of Electromagnetic Waves (MoE), Fudan University, Shanghai200433, China
  • show less
    DOI: 10.11972/j.issn.1001-9014.2020.04.012 Cite this Article
    Yu-Xi LIU, Bo ZHANG, Bin WANG. Semi-supervised semantic segmentation based on Generative Adversarial Networks for remote sensing images[J]. Journal of Infrared and Millimeter Waves, 2020, 39(4): 473 Copy Citation Text show less

    Abstract

    Semantic segmentation of very high resolution (VHR) remote sensing images is one of the hot topics in the field of remote sensing image processing. Traditional supervised segmentation methods demand a huge mass of labeled data while the labeling process is very consuming. To solve this problem, a semi-supervised semantic segmentation method for VHR remote sensing images based on Generative Adversarial Networks (GANs) is proposed, and only a few labeled samples are needed to obtain pretty good segmentation results. A fully convolutional auxiliary adversarial network is added to the segmentation network, conducing to keeping the consistency of labels in the segmentation results of VHR remote sensing images. Furthermore, a novel adversarial loss with attention mechanism is proposed in the paper in order to solve the problem of easy sample over-whelming during the updating process of the segmentation network constrained by the discriminator when the segmentation results can confuse the discriminator. The experimental results on ISPRS Vaihingen 2D Semantic Labeling Challenge Dataset show that the proposed method can greatly improve the segmentation accuracy of remote sensing images compared with other state-of-the-art methods.
    minGmaxDV(G,D)=  Ex~pdata(x)[logD(x)]+Ez~pz(z)[log(1-D(G(z)))]()

    View in Article

    LD=-h,w(1-yn)log(1-D(S(Xn))(h,w))+ynlog(D(Yn)(h,w))()

    View in Article

    Lce=-h,wcCYn(h,w,c)log(S(Xn)(h,w,c))()

    View in Article

    Ladv=-h,wlog(D(S(Xn))(h,w))()

    View in Article

    Lsemi=-h,wcC(I(D(S(Xn))(h,w)>Tsemi)Ŷn(h,w,c)log(S(Xn)(h,w,c)))()

    View in Article

    Ladv_att=-h,w(1-D(S(Xn))(h,w))γ   ·log(D(S(Xn))(h,w))()

    View in Article

    Lseg=Lce+λadvLadv_att+λsemiLsemi()

    View in Article

    OA=TP+TNTP+TN+FP+FN()

    View in Article

    F1=2PrecisionRecallPrecision+Recall()

    View in Article

    Precision=TPTP+FP()

    View in Article

    Recall=TPTP+FN()

    View in Article

    Yu-Xi LIU, Bo ZHANG, Bin WANG. Semi-supervised semantic segmentation based on Generative Adversarial Networks for remote sensing images[J]. Journal of Infrared and Millimeter Waves, 2020, 39(4): 473
    Download Citation