In this article, the PM, Jonswap, and Elfouhaily spectra were used to model the sea surface, and combining them with the measured data from Chinese stations, the radiances of seawater, sky, and atmosphere were calculated. The effects of wind speed and detection angle on the long-wave infrared polarization characteristics of the sea surface under different wave spectra were studied. Simulation results show that the long-wave infrared polarization characteristics of sea surface vary significantly during the day and night. When the detection angle of the PM spectrum is 80°, the average polarization degree of the sea surface reaches the maximum, while the corresponding detection angle for the Jonswap and Elfouhaily spectra is 70°. Under the same conditions, the incident angle distribution of the Jonswap and Elfouhaily spectra is relatively concentrated, and their average degree of polarization is higher than that of the PM spectrum. When the detection angle is 63°, the average degree of polarization of the sea surface modeled by the PM spectrum is unaffected by wind speed. The corresponding detection angle of the Jonswap and Elfouhaily spectra is 56°. When using different wave spectra to model the sea surface, the polarization characteristics of the simulated sea surface will be different. Therefore, the appropriate wave spectrum should be selected according to the characteristics of the sea surface scene to ensure the reliability of simulation results.