The optical transmission with plane wave incidence on the rough surface of layered medium is studied, the formulae of the transmission coefficient for different polarization states is derived using the perturbation method. An exponentially distributed rough surface is presented for describing the practical rough surface of layered medium, the transmission coefficient of HH polarization with the scattering angle of transmission wave is obtained by numerical calculation. The numerical results show that the transmission coefficient almost does not change with permittivity of the substrate medium. The magnitude and curve of the angular distribution for the transmission coefficient are affected by the the permittivity of intermediate medium. As the mean layer thickness of intermediate medium increases twice over, the period of the curves will decrease one half. The rough surface influences the magnitude of the transmission coefficient and the amplitude of the curve, the correlation length of the rough surface influences the magnitude of the transmission coefficient, the amplitude and varying trend of the curves. The transmission coefficient decreases oscillatorily with increase of the incident wavelength.