The polarization state of the incident light can be changed differently according to the polarization state, viewing and azimuth angles of the incident light when it passes through the optical surfaces of the polarization camera. By analyzing the interaction between the incident light and the polarization camera, the radiometric model including the polarization capability is deduced. Calibration method of the radiometric model parameters and retrieval of the polarization information is introduced, and the general project of calibration for correcting the polarization phenomena of polarization camera is designed. The quantitative relation between output signal of polarization camera and Stokes parameters is given for high-accuracy polarization remote sensing, which can facilitate the quantitative application of polarization remote sensing information.