The purpose of this paper is to find a practical and effective fusion method for infrared and visible images. On the basis of analyzing the characteristics of visible and infrared images, a novel method for fusion of the infrared and the visible images based on phase modulation is proposed. Phase modulation on the visible and infrared images is conducted. Then the fusion image through inverse transformation is obtained. Experimental results show that the method discussed above is effective in visual effect, the quantity of information, and the details of information. It also shows that this new method gets a better fusion image than wavelet transform.