To overcome the shortcomings of traditional distortion correction algorithms, an image distortion correction algorithm based on quadrilateral fractal approach controlling points is proposed. The standard raster image is used as the measurement target in the algorithm, the mathematical morphology is combined with sliding impending domain operation to fix on the distorted image’s pixel centroid, and the algorithm based on quadrilateral fractal approach controlling points is applied to fit high-order polynomial correction model. For image gray recovery, a two-step one-dimensional linear backward mapping method is used. The algorithm is applied on TMS320DM6437 DSP, and the experimental results show that for a 768 pixels×494 pixels image, the correction time is 0.036 s. The correction error is within 0.31 pixel and the edge information loss and inanition are effectively avoided.