Aiming at the characteristics of the ChangE′ 3 panoramic camera (binocular camera), an application of image quality evaluation method based on the structural similarity (SSIM) is proposed. After analyzing the ChangE′ 3 panoramic camera imaging principle and the traditional evaluation factors, the method is used for the quality evaluation of image pairs obtained by the panoramic camera. The evaluation factors can be applied to ChangE′ 3 evaluation of panoramic camera image pairs, and the method is superior to the common evaluation factors. Experiments show that this evaluation method as the quality evaluation factor is better than ever before, and it can apply in the assessment of stereo image matching subsequently.