Template updating method is the key of the success of the matching and tracking algorithm. In order to improve the performance of the tracking algorithm using template matching, a new method for tracking rigid objects in image sequences is proposed after analyzing many template updating methods. A Kalman filter is used to update the template dot by dot instead of renewing it as a whole, and make it adapt to changes in object orientation, illumination and occlusion. The new method improves the performance of the image matching and tracking. The experiments testify the algorithm′s efficiency.