Because the calculation results and efficiency of the methods of tracking moving object available are not satisfactory, an algorithm using improved Hausdorff distance in the template matching was proposed, which is little in calculating amount and strong in adaptability. To track the object in a high speed, multiresolution analysis is adopted to deal with the array images. Experimental results demonstrate that this method can improve the accuracy and efficiency of tracking moving object remarkably.