Aiming at the detecting and tracking of head-on point targets in complicated sea-sky background,an algorithm that could detect while tracking is proposed based on adjacent frame matching.The algorithm obtains the interest region by the adjacent frame matching in infrared image sequences,adopts a mark image to memorize the match result,adopts a statistical image to count the marking times of each pixels and outputs the statistical image to show head-on targets with input images.The algorithm is unique in no need to suppose the doubtful target points in advance;the single match process has nothing to do with other frames,and the whole match process does not change with the target movement state or the numbers of targets.Especially,the algorithm solves the head-on targets detection problems under the highly noisy condition.According to the simulations and experiments under the different condition time after time,it has been confirmed that the advantage above with high application value is different from the traditional algorithms and this method is of feasibility and validity.