A method of vehicle identification in natural scene was proposed for the target recognition of moving vehicles. Firstly, the image difference technique was used to study the significant characteristics of the target vehicle, and encode the local features and the image of the learning target, then the salient detection of the target vehicle was realized according to the above two information. Secondly, aiming at the complexity of vehicle movement, a block projection matching method was used for global motion estimation and compensation, and the difference technique was used to detect the motion feature. Then the target vehicle′s saliency features and the motion features were fused to obtain more accurate candidate target areas. Finally, the candidate region was further used to discriminate the target by using the visual features. The experiment shows that the method has good performance of target discrimination and can solve the problem of vehicle motion recognition in natural scene.