Boosting Quality of Pansharpened Images Using Deep Residual Denoising Network

Bin Yang; Xiang Wang

doi:10.3788/LOP56.161009

[1] Jiang C, Zhang H Y, Shen H F et al. Two-step sparse coding for the pan-sharpening of remote sensing images[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7, 1792-1805(2014).

[2] Yang C, Yang B, Huang G Y. Remote sensing image fusion based on multispectral image super-resolution[J]. Laser & Optoelectronics Progress, 53, 021001(2016).

[3] Tu T M, Huang P S, Hung C L et al. A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery[J]. IEEE Geoscience and Remote Sensing Letters, 1, 309-312(2004).

[4] Shah V P, Younan N H, King R L. An efficient pan-sharpening method via a combined adaptive PCA approach and contourlets[J]. IEEE Transactions on Geoscience and Remote Sensing, 46, 1323-1335(2008).

[5] Gillespie A R, Kahle A B, Walker R E. Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques[J]. Remote Sensing of Environment, 22, 343-365(1987).

[6] Laben C A. -01-04[2019-01-05]. http:∥google.com/patents/US6011875.(2000).

[7] Li S T. Multisensor remote sensing image fusion using stationary wavelet transform: effects of basis and decomposition level[J]. International Journal of Wavelets, Multiresolution and Information Processing, 6, 37-50(2008).

[8] Zheng S, Shi W Z, Liu J et al. Remote sensing image fusion using multiscale mapped LS-SVM[J]. IEEE Transactions on Geoscience and Remote Sensing, 46, 1313-1322(2008).

[9] Vivone G, Restaino R, Dalla Mura M et al. Contrast and error-based fusion schemes for multispectral image pansharpening[J]. IEEE Geoscience and Remote Sensing Letters, 11, 930-934(2014).

[10] Ghassemian H. A retina based multi-resolution image-fusion. [C]∥IEEE 2001 International Geoscience and Remote Sensing Symposium (Cat. No.01CH37217), July 9-13, 2001, Sydney, NSW, Australia. New York: IEEE, 709-711(2001).

[11] Han C, Zhang H Y, Gao C X et al. A remote sensing image fusion method based on the analysis sparse model[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 9, 439-453(2016).

[12] Ghamchili M, Ghassemian H. Panchromatic and multispectral images fusion using sparse representation. [C]∥2017 Artificial Intelligence and Signal Processing Conference (AISP), October 25-27, 2017, Shiraz, Iran. New York: IEEE, 80-84(2017).

[13] Scarpa G, Vitale S, Cozzolino D. Target-adaptive CNN-based pansharpening[J]. IEEE Transactions on Geoscience and Remote Sensing, 56, 5443-5457(2018).

[14] Yang J F, Fu X Y, Hu Y W et al. PanNet: a deep network architecture for pan-sharpening. [C]∥2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy. New York: IEEE, 1753-1761(2017).

[15] Wei Y C, Yuan Q Q, Shen H F et al. Boosting the accuracy of multispectral image pansharpening by learning a deep residual network[J]. IEEE Geoscience and Remote Sensing Letters, 14, 1795-1799(2017).

[16] Shao Z F, Cai J. Remote sensing image fusion with deep convolutional neural network[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 11, 1656-1669(2018).

[17] Yan M, Zhao H D, Li Y H et al. Multi-classification and recognition of hyperspectral remote sensing objects based on convolutional neural network[J]. Laser & Optoelectronics Progress, 56, 021702(2019).

[18] Wang M, Fan T F, Yun W G et al. PFWG improved CNN multispectra remote sensing image classification[J]. Laser & Optoelectronics Progress, 56, 031003(2019).

[19] Bao S Z, Zhong X, Zhu R F et al. Automatic detection method of ships based on shortwave infrared remote sensing images[J]. Acta Optica Sinica, 38, 0528001(2018).

[20] Zhang Q C, Tong G F, Li Y et al. River detection in remote sensing images based on multi-feature fusion and soft voting[J]. Acta Optica Sinica, 38, 0628002(2018).

[21] Zhang K, Zuo W M, Chen Y J et al. Beyond a Gaussian denoiser: residual learning of deep CNN for image denoising[J]. IEEE Transactions on Image Processing, 26, 3142-3155(2017).

[22] He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 770-778(2016).

[23] Kingma D P. -01-30)[2019-01-05]. https:∥arxiv., org/abs/1412, 6980(2017).

[24] Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. [C]∥32nd International Conference on Machine Learning, July 6-11, 2015, Lille, France. Massachusetts: JMLR.org, 448-456(2015).

[25] Colorado: DigitalGlobe. -01-20[2018-12-23]. http:∥glcf.umd.edu/data/quickbird/.(2002).

[26] Wald L, Ranchain T, Mangolini M. Fusion of satellite images of different spatial resolutions: assessing the quality of resulting images[J]. Photogrammetric Engineering and Remote Sensing, 63, 691-699(1997).

[27] Ranchin T, Aiazzi B, Alparone L et al. Image fusion: the ARSIS concept and some successful implementation schemes[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 58, 4-18(2003).

[28] Alparone L, Wald L, Chanussot J et al. Comparison of pansharpening algorithms: outcome of the 2006 GRS-S data-fusion contest[J]. IEEE Transactions on Geoscience and Remote Sensing, 45, 3012-3021(2007).

[29] Khan M M, Alparone L, Chanussot J. Pansharpening quality assessment using the modulation transfer functions of instruments[J]. IEEE Transactions on Geoscience and Remote Sensing, 47, 3880-3891(2009).

[30] Alparone L, Baronti S, Garzelli A et al. A global quality measurement of pan-sharpened multispectral imagery[J]. IEEE Geoscience and Remote Sensing Letters, 1, 313-317(2004).

[31] Li S T, Yang B. A new pan-sharpening method using a compressed sensing technique[J]. IEEE Transactions on Geoscience and Remote Sensing, 49, 738-746(2011).

[32] Masi G, Cozzolino D, Verdoliva L et al. Pansharpening by convolutional neural networks[J]. Remote Sensing, 8, 594(2016).