Based on the visual attention mechanism, a large number of subjective experiments were conducted to quantitatively study the chromaticity factors that affect the visual comfort of stereo images. First, the stereo salient map was obtained by combining disparity map and flat salient map, then the stereo salient map was optimized by using fuzzy membership and mask to get final salient image, and the eye tracker was used for the salient stereoscopic images to verify the rationality; then, a gradual approach method was used for subjective experiments to obtain experimental data, and after that remarkable comfortable color matching map and difference map of three-dimensional images in different scenes were obtained by a large number of subjective experiments. The experimental results show that the comfort and chromaticity interval of left and right view will vary with different scenes, and the maximum average chromaticity comfort difference of binocular vision can be 122.5°, that is to say, the chromaticity difference between left and right views should not be too large. The comfort and chromaticity range obtained can reflect the comfort of stereo images well, and provide the basis for judging the quality of stereoscopic information and more powerful technical support for stereo content making.