In order to reduce the complexity of calculation while processing large decreased image, an image restoration algorithm based on least square has been developed. When putting it into implementation, a new method named ally-template has been proposed, which parrys transform of frequency. Its algorithm architecture is easily implemented. The experimental results demonstrate this approach is effective.