Image Feature Fusion Based Remote Sensing Scene Zero-Shot Classification Algorithm

Chen Wu; Hongwei Wang; Yuwei Yuan; Zhiqiang Wang; Yu Liu; Hong Cheng; Jicheng Quan

doi:10.3788/AOS201939.0610002

[1] Liu D W, Han L, Han X Y. High spatial resolution remote sensing image classification based on deep learning[J]. Acta Optica Sinica, 36, 0428001(2016).

Liu D W, Han L, Han X Y. High spatial resolution remote sensing image classification based on deep learning[J]. Acta Optica Sinica, 36, 0428001(2016).

[2] Chen S Z, Tian Y L. Pyramid of spatial relations for scene-level land use classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 53, 1947-1957(2015). http://ieeexplore.ieee.org/document/6895132/

Chen S Z, Tian Y L. Pyramid of spatial relations for scene-level land use classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 53, 1947-1957(2015). http://ieeexplore.ieee.org/document/6895132/

[3] Zhang L P, Zhang L F, Du B. Deep learning for remote sensing data: a technical tutorial on the state of the art[J]. IEEE Geoscience and Remote Sensing Magazine, 4, 22-40(2016). http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7486259

Zhang L P, Zhang L F, Du B. Deep learning for remote sensing data: a technical tutorial on the state of the art[J]. IEEE Geoscience and Remote Sensing Magazine, 4, 22-40(2016). http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7486259

[4] Li A X, Lu Z W, Wang L W et al. Zero-shot scene classification for high spatial resolution remote sensing images[J]. IEEE Transactions on Geoscience and Remote Sensing, 55, 4157-4167(2017). http://ieeexplore.ieee.org/document/7902107/

Li A X, Lu Z W, Wang L W et al. Zero-shot scene classification for high spatial resolution remote sensing images[J]. IEEE Transactions on Geoscience and Remote Sensing, 55, 4157-4167(2017). http://ieeexplore.ieee.org/document/7902107/

[5] Xian Y Q, Akata Z, Sharma G et al. Latent embeddings for zero-shot classification. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 69-77(2016).

Xian Y Q, Akata Z, Sharma G et al. Latent embeddings for zero-shot classification. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 69-77(2016).

[6] Wang D, Li Y, Lin Y et al. Relational knowledge transfer for zero-shot learning[C]∥Thirtieth AAAI Conference in Artificial Intelligence, February 12-17, 2016, Phoenix, Arizona, USA., 2145-2151(2016).

Wang D, Li Y, Lin Y et al. Relational knowledge transfer for zero-shot learning[C]∥Thirtieth AAAI Conference in Artificial Intelligence, February 12-17, 2016, Phoenix, Arizona, USA., 2145-2151(2016).

[7] Zhang Z M, Saligrama V. Zero-shot learning via joint latent similarity embedding. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 6034-6042(2016).

Zhang Z M, Saligrama V. Zero-shot learning via joint latent similarity embedding. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 6034-6042(2016).

[8] Zhang Z M, Saligrama V. Zero-shot learning via semantic similarity embedding. [C]∥2015 IEEE International Conference on Computer Vision (ICCV), December 7-13, 2015, Santiago, Chile. New York: IEEE, 4166-4174(2015).

Zhang Z M, Saligrama V. Zero-shot learning via semantic similarity embedding. [C]∥2015 IEEE International Conference on Computer Vision (ICCV), December 7-13, 2015, Santiago, Chile. New York: IEEE, 4166-4174(2015).

[9] Wang Q, Chen K. Zero-shot visual recognition via bidirectional latent embedding[J]. International Journal of Computer Vision, 124, 356-383(2017). http://link.springer.com/10.1007/s11263-017-1027-5

Wang Q, Chen K. Zero-shot visual recognition via bidirectional latent embedding[J]. International Journal of Computer Vision, 124, 356-383(2017). http://link.springer.com/10.1007/s11263-017-1027-5

[10] Li Y N, Wang D H, Hu H H et al. Zero-shot recognition using dual visual-semantic mapping paths. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 5207-5215(2017).

Li Y N, Wang D H, Hu H H et al. Zero-shot recognition using dual visual-semantic mapping paths. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 5207-5215(2017).

[11] Kodirov E, Xiang T, Gong S G. Semantic autoencoder for zero-shot learning. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 4447-4456(2017).

Kodirov E, Xiang T, Gong S G. Semantic autoencoder for zero-shot learning. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 4447-4456(2017).

[12] Fernando B, Fromont E, Muselet D et al. Discriminative feature fusion for image classification. [C]∥2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 16-21, 2012, Providence, RI, USA. New York: IEEE, 3434-3441(2012).

Fernando B, Fromont E, Muselet D et al. Discriminative feature fusion for image classification. [C]∥2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 16-21, 2012, Providence, RI, USA. New York: IEEE, 3434-3441(2012).

[13] Bao C L, Ji H, Quan Y H et al. Dictionary learning for sparse coding: algorithms and convergence analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 1356-1369(2016). http://ieeexplore.ieee.org/document/7293682

Bao C L, Ji H, Quan Y H et al. Dictionary learning for sparse coding: algorithms and convergence analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 1356-1369(2016). http://ieeexplore.ieee.org/document/7293682

[14] Yang M, Chang H Y, Luo W X. Discriminative analysis-synthesis dictionary learning for image classification[J]. Neurocomputing, 219, 404-411(2017). http://www.sciencedirect.com/science/article/pii/S0925231216310657

Yang M, Chang H Y, Luo W X. Discriminative analysis-synthesis dictionary learning for image classification[J]. Neurocomputing, 219, 404-411(2017). http://www.sciencedirect.com/science/article/pii/S0925231216310657

[15] Wang J J, Guo Y Q, Guo J et al. Synthesis linear classifier based analysis dictionary learning for pattern classification[J]. Neurocomputing, 238, 103-113(2017). http://www.sciencedirect.com/science/article/pii/S0925231217301157

Wang J J, Guo Y Q, Guo J et al. Synthesis linear classifier based analysis dictionary learning for pattern classification[J]. Neurocomputing, 238, 103-113(2017). http://www.sciencedirect.com/science/article/pii/S0925231217301157

[16] Ravishankar S, Bresler Y. Sparsifying transform learning with efficient optimal updates and convergence guarantees[J]. IEEE Transactions on Signal Processing, 63, 2389-2404(2015). http://ieeexplore.ieee.org/document/7045534/

Ravishankar S, Bresler Y. Sparsifying transform learning with efficient optimal updates and convergence guarantees[J]. IEEE Transactions on Signal Processing, 63, 2389-2404(2015). http://ieeexplore.ieee.org/document/7045534/

[17] Xia G S, Hu J W, Hu F et al. AID: a benchmark data set for performance evaluation of aerial scene classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 55, 3965-3981(2017). http://ieeexplore.ieee.org/document/7907303

Xia G S, Hu J W, Hu F et al. AID: a benchmark data set for performance evaluation of aerial scene classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 55, 3965-3981(2017). http://ieeexplore.ieee.org/document/7907303

[18] Swain M J, Ballard D H. Color indexing[J]. International Journal of Computer Vision, 7, 11-32(1991).

Swain M J, Ballard D H. Color indexing[J]. International Journal of Computer Vision, 7, 11-32(1991).

[19] Ojala T, Pietikainen M, Maenpaa T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 971-987(2002). http://bioinformatics.oxfordjournals.org/external-ref?access_num=10.1109/TPAMI.2002.1017623&link_type=DOI

Ojala T, Pietikainen M, Maenpaa T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 971-987(2002). http://bioinformatics.oxfordjournals.org/external-ref?access_num=10.1109/TPAMI.2002.1017623&link_type=DOI

[20] Lowe D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 60, 91-110(2004). http://doi.ieeecomputersociety.org/resolve?ref_id=doi:10.1023/B:VISI.0000029664.99615.94&rfr_id=trans/tp/2008/10/ttp2008101683.htm

Lowe D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 60, 91-110(2004). http://doi.ieeecomputersociety.org/resolve?ref_id=doi:10.1023/B:VISI.0000029664.99615.94&rfr_id=trans/tp/2008/10/ttp2008101683.htm

[21] Oliva A, Torralba A. Modeling the shape of the scene: a holistic representation of the spatial envelope[J]. International Journal of Computer Vision, 42, 145-175(2001). http://www.tandfonline.com/servlet/linkout?suffix=cit0015&dbid=16&doi=10.1080%2F0952813X.2015.1020572&key=10.1023%2FA%3A1011139631724

Oliva A, Torralba A. Modeling the shape of the scene: a holistic representation of the spatial envelope[J]. International Journal of Computer Vision, 42, 145-175(2001). http://www.tandfonline.com/servlet/linkout?suffix=cit0015&dbid=16&doi=10.1080%2F0952813X.2015.1020572&key=10.1023%2FA%3A1011139631724

[22] Yang Y, Newsam S. Bag-of-visual-words and spatial extensions for land-use classification. [C]∥Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, November 2-5, 2010, San Jose, California. New York: ACM, 270-279(2010).

Yang Y, Newsam S. Bag-of-visual-words and spatial extensions for land-use classification. [C]∥Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, November 2-5, 2010, San Jose, California. New York: ACM, 270-279(2010).

[23] Perronnin F, Sánchez J, Mensink T. Improving the fisher kernel for large-scale image classification[M]. ∥Daniilidis K, Maragos P, Paragios N. Computer Vision-ECCV 2010. Berlin, Heidelberg: Springer, 143-156(2010).

Perronnin F, Sánchez J, Mensink T. Improving the fisher kernel for large-scale image classification[M]. ∥Daniilidis K, Maragos P, Paragios N. Computer Vision-ECCV 2010. Berlin, Heidelberg: Springer, 143-156(2010).

[24] Blei D M, Ng A Y, Jordan M I. Latent dirichl location[J]. Journal of Machine Learning research, 3, 993-1022(2003).

Blei D M, Ng A Y, Jordan M I. Latent dirichl location[J]. Journal of Machine Learning research, 3, 993-1022(2003).

[25] Jia Y Q, Shelhamer E, Donahue J et al. Caffe: convolutional architecture for fast feature embedding. [C]∥Proceedings of the 22nd ACM international conference on Multimedia, November 3-7, 2014, Orlando, Florida, USA. New York: ACM, 675-678(2014).

Jia Y Q, Shelhamer E, Donahue J et al. Caffe: convolutional architecture for fast feature embedding. [C]∥Proceedings of the 22nd ACM international conference on Multimedia, November 3-7, 2014, Orlando, Florida, USA. New York: ACM, 675-678(2014).

[26] Simonyan K. -04-10)[2018-12-25]. https: ∥arxiv., org/abs/1409, 1556(2015).

Simonyan K. -04-10)[2018-12-25]. https: ∥arxiv., org/abs/1409, 1556(2015).

[27] Szegedy C, Liu W, Jia Y Q et al. Going deeper with convolutions. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 1-9(2015).

Szegedy C, Liu W, Jia Y Q et al. Going deeper with convolutions. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 1-9(2015).

[28] He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 770-778(2016).

He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 770-778(2016).

[29] Wang J J, Yang J C, Yu K et al. Locality-constrained linear coding for image classification. [C]∥2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), June 13-18, 2010, San Francisco, CA, USA. New York: IEEE, 3360-3367(2010).

Wang J J, Yang J C, Yu K et al. Locality-constrained linear coding for image classification. [C]∥2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), June 13-18, 2010, San Francisco, CA, USA. New York: IEEE, 3360-3367(2010).

[30] Bosch A, Zisserman A, Muñoz X. Scene classification via pLSA[M]. ∥Leonardis A, Bischof H, Pinz A. Computer Vision-ECCV 2006. Berlin, Heidelberg: Springer, 517-530(2006).

Bosch A, Zisserman A, Muñoz X. Scene classification via pLSA[M]. ∥Leonardis A, Bischof H, Pinz A. Computer Vision-ECCV 2006. Berlin, Heidelberg: Springer, 517-530(2006).

[31] Lazebnik S, Schmid C, Ponce J. Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. [C]∥2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), June 17-22, 2006, New York, USA. New York: IEEE, 2169-2178(2006).

Lazebnik S, Schmid C, Ponce J. Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. [C]∥2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), June 17-22, 2006, New York, USA. New York: IEEE, 2169-2178(2006).

[32] Jegou H, Perronnin F, Douze M et al. Aggregating local image descriptors into compact codes[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34, 1704-1716(2012). http://europepmc.org/abstract/MED/22156101

Jegou H, Perronnin F, Douze M et al. Aggregating local image descriptors into compact codes[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34, 1704-1716(2012). http://europepmc.org/abstract/MED/22156101

[33] Rupnik J, Shawe-Taylor J. Multi-view canonical correlation analysis. [C]∥Proceedings of the 13th Multiconference on Information Society, IS, Ljubljana, Slovenia. [S.l.: s.n.], 201-204(2010).

Rupnik J, Shawe-Taylor J. Multi-view canonical correlation analysis. [C]∥Proceedings of the 13th Multiconference on Information Society, IS, Ljubljana, Slovenia. [S.l.: s.n.], 201-204(2010).