A high-precision Fiber Bragg Grating （FBG） displacement sensor was proposed based on the combination of a spring and a slider. It can realize the displacement measurement and temperature compensation on a single fiber， which greatly reduces space occupation. Experimental results show that the sensor has excellent micro-displacement measurement capability， its sensitivity， accuracy and the range are 145.08 pm/mm， 1.43%， 1.55% and 10 mm， respectively. The relative error of static synthesis is 2.88%， and the overall error of linearity， repeatability and hysteresis are small. By comparing the temperature compensation effect of aluminum alloy substrate， non-substrate and quartz substrate， it is found that the sensor temperature compensation effect of quartz substrate is better which the delay time is reduced from 6.8 min to 4.3 min， and the maximum temperature compensation error is reduced from 44 pm to 40 pm. Finally， the temperature sensitivity of the sensor made of quartz glass substrate is 6.34 PM/℃ and the temperature compensation error is 0.26%. All of those implies the sensor is suitable for online monitoring of high-precision structural displacements such as mechanical equipment and civil engineering.