The current infrared and visible image fusion faces the difficult of obtaining infrared target and extracting the scene of visible image. An infrared and visible image fusion method based on Nonsubsampled Contoutlet Transform (NSCT) is proposed by using the advantage of nonsubsampled Contoutlet transform’s direction and anisotropy. Firstly, the source images were decomposed. Then, low-frequency sub-band establishes new feature energy, and weights it for the fusion. And high-frequency sub-band selects the max variance of the image fusion rules. By using the algorithm for infrared and visible light images in the fusion experiments, the fusion quality assessment is given. The experimental results show that the proposed image fusion algorithm gets more image detail in the information, and the amount of information has be increased significantly.