Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

Chaoying Tang; Shiliang Pu; Pengzhao Ye; Fei Xiao; Huajun Feng

doi:10.3788/AOS202040.1610001

[1] Zhou X L, Jiang Z T. Infrared and visible image fusion combining pulse-coupled neural network and guided filtering[J]. Acta Optica Sinica, 39, 1110003(2019).

[2] Lim C B, Salud M M, Uttoh B et al. Coloring high-resolution near-infrared images using chromatic cues from low-resolution references[C]∥2015 International Conference on Humanoid, December 9-12, 2015, Cebu City, Philippines., 1-5(2015).

[3] Son C H, Zhang X P. Near-infrared coloring via a contrast-preserving mapping model[J]. IEEE Transactions on Image Processing, 26, 5381-5394(2017).

[4] Son C H, Zhang X P. Layer-based approach for image pair fusion[J]. IEEE Transactions on Image Processing, 25, 2866-2881(2016).

[5] Son C H. Near-infrared fusion via a series of transfers for noise removal[J]. Signal Processing, 143, 20-27(2018).

[6] Dabov K, Foi A, Katkovnik V et al. Image denoising by sparse 3-D transform-domain collaborative filtering[J]. IEEE Transactions on Image Processing, 16, 2080-2095(2007).

[7] Su H N, Jung C. Multi-spectral fusion and denoising of RGB and NIR images using multi-scale wavelet analysis[C]∥2018 24th International Conference on Pattern Recognition (ICPR), August 20-24, 2018, Beijing, China., 1779-1784(2018).

[8] Jung T Y, Son D M, Lee S H. Visible and NIR image blending for night vision[C]∥ International Conference on Image Processing, Computer Vision and Pattern Recognition (IPCV)., 110-113(2019).

[9] Jee S, Kang M G. Sensitivity improvement of extremely low light scenes with RGB-NIR multispectral filter array sensor[J]. Sensors, 19, 1256(2019).

[10] He K M, Sun J, Tang X O. Guided image filtering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1397-1409(2013).

[11] Jung C, Zhou K L, Feng J W. FusionNet: multispectral fusion of RGB and NIR images using two stage convolutional neural networks[J]. IEEE Access, 8, 23912-23919(2020).

[12] Matthew B, Sabine S. Multi-spectral SIFT for scene category recognition. [C]∥ IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 20-25, 2011, Providence, RI, USA. New York: IEEE, 12218780(2011).

[13] ClausM, Gemert JV. ViDeNN: deep blind video denoising[C]∥2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), June 16-17, 2019, Long Beach, CA, USA. New York: IEEE Press, 2019: 1843- 1852.

[14] Brooks T, Mildenhall B, Xue T F et al. Unprocessing images for learned raw denoising[C]∥2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 15-20, 2019, Long Beach, CA, USA., 11028-11037(2019).

[15] Mildenhall B, Barron J T, Chen J W et al. Burst denoising with kernel prediction networks[C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. June 18-23, 2018, Salt Lake City, UT, USA., 2502-2510(2018).

[16] Johnson J, Alahi A, Li F F[M]. Perceptual losses for real-time style transfer and super-resolution, 694-711(2016).

[17] Sun D Q, Yang X D, Liu M Y et al. PWC-, 8934-8943(2018).

[18] Fu X Y, Zeng D L, Huang Y et al. A weighted variational model for simultaneous reflectance and illumination estimation[C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR, June 27-30, 2016, Las Vegas, NV, USA., 2782-2790(2016).

[19] Ronneberger O, Fischer P, Brox T[M]. U-net: convolutional networks for biomedical image segmentation, 234-241(2015).

[20] Simonyan K. -09-04)[2020-03-24]. https: ∥arxiv., org/abs/1409, 1556(2014).

[21] Wang Z, Bovik A C, Sheikh H R et al. Image quality assessment: from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 13, 600-612(2004).

[22] Zeng H, Zhang L, Bovik A C. Blind image quality assessment with a probabilistic quality representation[C]∥2018 25th IEEE International Conference on Image Processing (ICIP), October 7-10, 2018, Athens, Greece., 609-613(2018).