A method of detecting and tracking light points in realtime images was proposed. Detection of light points was based on analyzing of the segmentation results and graylevel change in different directions, which can distinguish light points from reflector points. Tracking of light points is based on adaptive adjustment of gate size and gate position. In order to improve computing precision, the Cardinal spline functions are used as the interpolating functions. This method is feasible and the results agree with the relative experiment.