A new method based on the corner feature and affine transformation is presented in order to realize automatic registration of infrared image and visual image,including corner extraction,edge extraction,corner match and affine transformation.Harris factor is used to detect the corners,and Canny operate is used to extract the edges in two images.The correlation of corner neighborhood is used in edge images to realize coarse corners match.Corners match is refined,and two pairs of corners are chosen as reference point of affine transformation,which are the best in matched corners.The affine transformation model is obtained,and affine transformation in the image prepared for registration is carried out.The experiment results show that the method can well complete automatic registration of infrared image and visual image at a faster registration speed.