According to the low-temperature and low-drift requirements for the HgCdTe SWIRFPA(short wave infrared focal plane array)， a temperature controlling system was designed and implemented based on thermoelectric refrigeration. The system has a good performance of small volume， rapid response， high precision of temperature controlling and working stability. The experiment results indicate that the SWIRFPA can work at 195K with the steady error maintained within 0.1℃ by using this temperature controlling system， and at the same time the dark current and the noise level of the SWIRFPA have been decreased dramatically.