To reduce the effect of main lens installation error and diffuse consistency on the accuracy of micro-lens array center calibration, we present a micro-lens array center calibration method in a coarse-to-fine manner via local searching. It can determine the ownership of pixels and micro-lens precisely. On the basis of the coarse center, we acquire alternative centers by locally searching its neighbor pixels. To accurately locate the fined-tuning center, we calculate the Euclidean distance between the coarse center and alternative centers. The calibration result demonstrate that compared with other advanced calibration algorithms, the distance error of our approach is smaller, and the accuracy is improved by 3.88%. Further, we conduct color correction and refocusing experiments. Experimental results demonstrate that the colorful image by our method is more real and natural, and its information entropy is higher. Besides, the refocused image has higher image clarity for both indoor and outdoor complex natural scenes.