A fast and robust front-view object location algorithm based on point pattern matching is proposed. It transforms the problem of front-view object location to the problem of matching between a 2-d point set and a 3-d point set. The matching matrix and the transformation parameter are solved through minimizing the object function restricted bi-directionally by matching one to one in the two point sets. The fuzzy degree of matching matrix is controlled by the temperature of deterministic annealing algorithm, which improves the robustness of the algorithm and reduces the possibility of getting trapped in local minima. The effectiveness and robustness of algorithm are indicated through experiments.