A restoration algorithm of local uniform motion blurred image based on Z transform for invariant background motion image detection was proposed. Suppose the foreground and the background is easy to be separated from blurred image. Image foreground was extracted from blurred image based on background subtraction method. Other direction movement of image foreground in the image space was converted into X axis direction movement by rotation matrix. In order to simplify the complex restoration process of local-blurred image, the whole procedure was divided into two steps: 1) image foreground restoration; 2) integration of foreground and background. Restoration and degradation model was established based on Z transform by strict mathematical deduction. Difference equation was changed into algebraic equation to simplify the solving process. Simulation results shown that the proposed method can be restored blurred image of local uniform motion correctly, effectively and rapidly. The algorithm is not sensitive to fuzzy degree; have a certain stability and superiority compared to Wiener filter restoration algorithm.