In consideration of the characteristic of polarization image which can enhance the target identification,a polarization system in visible light and the dual-tree complex wavelet transform(DTCWT) fusion algorithm of polarization image were proposed. In the low-pass sub-band of wavelet coefficients,the fuse rule based window energy was adopted,and in the high-pass sub-band,the rule of spatial frequency self-adaption weighted at window was selected. The setting of autocorrelation and the application of simulated annealing algorithm improved the robustness and adaptability of fusion. The results show that the fused image has good subjective quality and objective evaluation of performance which will enhance the target and background contrast.