In order to ensure the relative accuracy of measurement results of the imaging spectrometer, we must eliminate the polarization response of the optical devices in the spectrometer. A common method is adding depolarizer. The detection performance of the imaging spectrometer requires the depolarizer not only has the good depolarizing effect in response waveband of the spectrometer, but also affects the imaging quality of spectrometer as little as possible. In this paper, a compact double wedge depolarizer of limb imaging spectrometer for atmosphere remote sensing detection is studied. The wedge angle of the depolarizer is calculated and analyzed by means of integration, in addition, the parameters that affect the performance of the depolarizer are determined by MATLAB optimization simulation, and the related error analysis is carried out.