A mathematical model to detect the moving targets by the discontinuous frame difference vector's infinite norm is proposed. Then the parallel processing construction system is established, which can make full use of the moving point targets detection ability of the discontinuous frame difference vector's infinite norm. Due to the algorithm is based on the discontinuous frame difference, the parallel processing system can detect not only the moving point targets whose displacement is no less than one pixel between two continuous frames, but also the moving point targets whose displacement is no more than one pixel between two continuous frames but larger than one pixel between two discontinuous frames. Therefore, the ability of detecting and recognizing the moving point targets is highly improved. The experimental result shows that the algorithm is efficient.