Since the result of evaluation usually had ambiguity, it is difficult to define the performance of image matching algorithm with “good” or “bad”. So the performance of image matching algorithm can be evaluated by comprehensive evaluation method in fuzzy theories, which indicated the degree of evaluation results belonging to a certain review. Finally, it can get more scientific evaluation results. Combined with image matching algorithm performance evaluation of multiple criteria, the modeling course and the method for determining the weight were explained. With the evaluation experiments, the performance of gray correlation matching algorithm and phase correlation matching algorithm was evaluated by using the model. Compared with the single criteria evaluation architecture, the evaluation result is better. The practicality and effectiveness of the evaluation model are proved.