A new image stitching algorithm is proposed based on depth images series, to overcome the limit of field-of-view of depth reconstruction from three-dimensional light field. At pre-processing stage, bilateral filter and interpolation is utilized to de-noise. A corner detection algorithm based on edge local-maximum curvature value, and a matching algorithm based on minimum curvature variance control are proposed. Improved weighted average method is adopted to complete image fusion, both retain image's details and expand field-of-view. Experimental results show that the proposed system can easily obtain a complete depth image, which is helpful for three-dimensional reconstruction of whole scene.