The visual tracking based on phase correlation is always failure, because the response is dirac delta function disturbed by the noise and cluster. The desired correlated output distribution is adopted in average of synthetic exact filters, which obtains the excellent filtered result. This paper designs the response related with the object′s spatial position to replace the dirac delta function, which can achieve a robust filter. In order to adapt the changed object, peak-to-sidelobe ration was used to evaluate the results to update the filter. The fast Fourier transform was used to accelerate the algorithm to track the object fast and robustly. The experiments show that the proposed method can process 50 frames per second, and excels the state-of-the-art methods in both accuracy and precision.