The high speed imaging processing module based on MWIR cooled 320×256 detector, SDRAM memory and other function module circuit was designed for time-sharing type polarization imaging system. Processing module mainly included the driver board connected to detector, processing board with FPGA as its core, system power supply board. The algorithm of blind pixels compensation, nonuniformity correction, plateau histogram equalization and linear mapping were implemented, calibration parameters can be calculated online. Image processing module can realize the synchronization switch, integral time adjusted continuously, frame rate up to 200 fps, and output 320×256 pixels high quality infrared image, meeting the requirement of the polarization imaging system to detect moving objects. Infrared polarization imaging experiments on plastic cups with groove were carried out, effective Stokes parameter images were extracted from the polarization images, and the significant polarization properties were observed. The processing module can be applied to the detection of space target, mine detection, maritime search and camouflage target detection.