Taking LYTRO camera as an example, we propose a super-resolution algorithm for light field image with precise color vector. According to the hexagonal distribution of the microlens array inside the camera, combining with the point spread function and the arrangement of the filters on the camera detector array, we calculate the RGB color component values of each single pixel point, and accurately recover the color information of each pixel. The timeliness of color restoration is optimized by using pyramid algorithm. In the second part, a super-resolution algorithm based on color vector constraint of camera sub-aperture image sequence is proposed to improve image quality. The proposed color restoration method can be applied to many kinds of light field cameras. At the same time, the color vector is used as the constraint condition, and the color super-resolution image restoration effect is ideal.