In order to realize the rapid and high precision calibration of standard scattering plate, the standard scattering plate calibration system used in calibration visibility meter was established. The design method of panoramic imaging colorimeter optical system of the calibration system was researched. Based on the optical properties of parabolic reflector, the calculation method of paraboloid surface was deduced. Then, according to the requirement of the calibration system optical system, the design of optical system of panoramic imaging colorimeter optical system was completed. Finally, the panoramic imaging colorimeter optical system was modeling analyzed, and an experiment was designed to verifies the correctness of the design and simulation results. The experiment shows that the spatial measuring range is in the range of incident angle from 0°to 90° and azimuth angle from 0°to 360°; and the angular resolution is 1° which satisfy the design requirements of the optical system of the standard scattering plate calibration system used in a calibration visibility meter.