Diffraction grating is a key component in holographic waveguide helmet-mounted display system. However, in color display, incident polychromatic light comprised of red, green and blue wavelengths will diffract different angles. After several total reflections in the waveguide, the light of three wavelengths arrives at different locations at the output grating, thereby resulting in dispersion. Aiming at the chromatic dispersion problem in the holographic waveguide helmet-mounted display system and based on the characteristics of holographic waveguide system itself, this paper presents a multi-layer design of the waveguide for dispersion correction. According to the diffraction angle of the incident light with different wavelengths, waveguide of four layers with different refractive indexs was designed. The optical paths of different wavelengths were corrected to achieve the goal of dispersion correction. Simulations were carried out to verify the accuracy of the design. The results show that: the red, green, and blue light almost exit at the same position, presenting a highly overlapping color pattern. Therefore, the method can effectively solve the problem of the dispersion of the holographic waveguide helmet-mounted display system.