Biometric identification plays an important role in the field of information security. As a new biometric identification method, Palmprint identification has the advantages of low distortion, non-invasiveness and high uniqueness. Traditional palmprint research mostly uses natural light imaging systems to acquire in grayscale format, and it is not easy to improve the recognition accuracy further. In order to obtain more identification information, a multispectral palmprint image is proposed to replace the natural light palmprint image. Aiming at the problem that the existing palmprint recognition algorithms do not consider the characteristics of different spectra, resulting in loss of texture details and low recognition accuracy, a palmprint recognition algorithm based on multi-spectral image fusion is proposed. This method decomposes the multispectral palmprint image into a series of two-dimensional intrinsic mode functions (BIMF) with frequencies from high to low and a Residual component, which can be regarded as a preliminary estimate of the low-frequency information of the spectral image. Since the illumination conditions are unstable during the image acquisition process, and the near-infrared spectral image is sensitive to illumination transformation during FABEMD decomposition, it is easy to cause the decomposed BIMF background information to be too redundant. Therefore, the background reconstruction of the decomposed near-infrared palmprint image is performed. And feature refinement, which effectively enhances the feature expression of high-frequency information while smoothing the background redundant information. In order to avoid the problem of image overexposure caused by the spectral information after direct fusion processing, it is proposed to compress the near-infrared features before fusion. In addition, an improved residual network (IRCANet) combined with an attention mechanism is proposed for palmprint image classification after fusion, and a staged residual structure is introduced into the network to alleviate the degradation problem of the network. For the fused multispectral palmprint image, the staged residual structure can stably transmit image information between networks, but the effect of distinguishing high and low-frequency information in the image is not significant enough. In order to make the network pay attention to More discriminative features, use the interdependence between feature channels and incorporate a channel attention mechanism in the staged residual structure. Finally, comprehensive experiments on the multispectral palmprint dataset of the Hong Kong Polytechnic University (PolyU) show that the method can achieve good results, and the algorithm recognition accuracy can reach 99.67% and has good real-time performance.