Infrared and Visible Image Registration for Power Equipments Based on Deep Learning

Tian FU; Changzheng DENG; Xinyue HAN; Mengqing GONG

[5] MA J Y, JIANG X Y, FAN A X, et al. Image matching from handcrafled to deep features: A survey [J]. International Journal of Computer Vision, 2021, 129(1): 23-79.

[7] WU G R, KIM M, WANG Q, GAO Y Z, et al. Unsupervised deep feature learning for deformable registration of MR brain image[C]//Proceedings of the 16th International Conference on Medical Image Computing and Computer-Assisted Intervention, 2013: 649-656.

[8] CHENG X, ZHANG L, ZHENG Y F. Deep similarity learning for multimodal medical images[J]. Computer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization, 2018, 6(3): 248-252.

[9] Simonovsky M, Gulierrez-Becker B, Mateus D, et al. A deep metric for multimodal registration[C]//Proceedings of the 19th International Conference on Medical Image Computing and Computer Assisted Intervention, 2016: 10-18.

[10] Kabus S, Netsch T, Fischer B, et al. B-spline registration of 3D images with Levenberg-Marquardt optimization[C]//Proceedings of SPIE, Medical Imaging, Image Processing, 2004, 5370: 304-313.

[11] TANG L S, Hamarneh G, Celler A. Co-registration of bone CT and SPECT images using mutual information[C]//IEEE International Symposium on Signal Processing and Information Technology, 2006: 116-121.

[12] MIAO S, WANG Z J, LIAO R. A CNN regression approach for real-time 2D/3D registration[J]. IEEE Transactions on Medical Imaging, 2016, 35(5): 1352-1363.

[13] HAN Xufeng, LEUNG T, JIA Y, et al. MatchNet: Unifying feature and metric learning for patch-based matching[C]//2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015: 3279-3286, Doi: 10.1109/CVPR.2015.7298948.

[14] Krebs J, Mansi T, Delingette H, et al. Robust non-rigid registration through agent-based action learning[C]// Proceedings of the 20th International Conference on Medical Image Computing and Computer-Assisted Intervention, 2017: 344-35.

[15] Dosovitskiy A, Fischer P, Ilg E, et al. FlowNet: learning optical flow with convolutional networks[C]// Proceedings of IEEE International Conference on Computer Vision, 2015: 2758-2766.

[16] LI H W, WANG B H, LI L. Research on the infrared and visible power-equipment image fusion for inspection robots[C]//2010 1st International Conference on Applied Robotics for the Power Industry, 2010: 1-5.

[20] Taylor S, Drummond T. Binary histogrammed intensity patches for efficient and robust matching[J]. International Journal of Computer Vision, 2011, 94(2): 241-265.

[21] MA W, ZHANG J, WU Y, et al. A novel two-step registration method for remote sensing images based on deep and local features[J]. IEEE Trans Geosci Remote Sen, 2019, 57: 4834-4843.

[22] YE F, SU Y, XIAO H, et al. Remote sensing image registration using convolutional neural network features[J]. IEEE Geosci. Remote Sens Lett., 2018, 15: 232-236.

[23] LIU X L, JIANG D S, WANG M N, et al. Image synthesis based multi-modal image registration framework by using deep fully convolutional networks[J]. Medical & Biological Engineering & Computing, 2019, 57(5): 1037-1048.

[25] Salakhutdinov R, Hinton G E. Deep Boltzmann machines[C]// Proceedings of the 12th International Conference on Artificial Intelligence and Statistics, 2009: 448-455.

[30] FU J, LI W S, XU L M. DSAGAN: A generative adversarial network based on dual-stream attention mechanism for anatomical and functional image fusion [J]. Information Sciences, 2021, 576: 484-506.