An optical Fabry-Pérot cavity composed of ultra-low expansion glass material and a vacuum temperature control system are designed. The temperature of the Fabry-Pérot cavity can be precisely tuned from 10 ℃ to 40 ℃ when we use the double temperature control system, and the temperature fluctuation of the system is within ±0.004 ℃ in 24 h. The variations in resonant frequency of the F-P cavity and expansion coefficient of the cavity material with temperature are measured when we analyze the F-P cavity resonant frequency and the saturated absorption spectrum of Cs atom. The zero expansion temperature (29.286±0.057 ℃) is determined accurately when we fit the measured data. An optical frequency standard with thermal stability of 3.494×10-14 is expected to obtained by the proposed temperature control system.